I think we should take another look at Slashdot’s moderation and meta-moderation system:

• Users couldn’t just vote on everything; “modpoints” (upvotes/downvotes, but also with a reason attached) were a limited resource.
• Comments scores were bounded to [-1, 5] instead of being unbounded.
• Most importantly, what wasn’t limited was that users had the opportunity to “meta-moderate:” they would be shown a set of moderation actions and be asked to give a 👍 or 👎 based on whether they agreed with the modpoint usage or not.
• Users would be awarded modpoints based on their karma (how their own comments had been modded by others) and their judgement (whether people agreed or not with their modpoint usage).

Admittedly the exact formula Slashdot used for awarding modpoints was secret to prevent people from gaming it, which doesn’t exactly work for Lemmy, but the point is that I think the idea of using more than one kind of signal to determine reputation is a good one.

You’d need to limit the capacity to vote on credibility to people who are members of the community. If you haven’t joined, you can’t make a judgment about what is or isn’t a good faith post, but your own post can be voted by members. Rather than being attached to just the user, it would probably be better if it were referenced to the user per community. Even so, it’s essentially karma, and could probably be gamed.

Otherwise, you’ve just reinvented upvotes.

Is this for an online community like Lemmy, or more oriented towards fixing the credit institutions?

in any case, a credibility metric would soon turn into a goal to achieve ^(karmafarming says what?)^

A metric ceases to be useful when it becomes a goal.

People will vote for what they like, not what’s good faith.

I love the concept, but the ugly reality is that anyone can spin up an instance and pour in an arbitrary number of votes to themselves or anyone else. I think the credibility score would give people a false confidence and honestly do more harm than good unfortunately

There was a great DefCon talk recently about how a guy gained credibility on the dark web over the course of a few years and it was easy to do by just being helpful to others. People tend to trust those who are helpful.

After awhile, he got busted and the feds took over his ToR identity and used his credibility to bust some criminals on the dark web.

I recommend being suspicious of everyone you interact with online.

your attempt at convincing people why to use a button will fail. they will do what they want. technical solutions for human behaviors can be difficult because humans do not generally like to be told what to do

mbin already has ‘reputation’ exposed

Most people (including myself) would like to agree with you on building some sort of system to create credibility or honesty or reliability among people on a social media platform. I think the majority of people that use any social media (including Lemmy) would probably agree and more than likely would participate in it.

Unfortunately, it only takes a small group of people to upset the system, game the system, play with the system or create situations or systems of their own to manipulate everything … either to fight against others, or to generate some sort of power or control of their own. All it would take is this small group to completely change everything and make everything difficult and non functional.

It’s a lot like the democratic system of government. When you think about it the majority of everyone would like to participate in it and make it work … unfortunately, its only a small group of powerful individuals who have gamed the system to give themselves and their friends power over everyone else.

You will likely find such a system is ineffective because popular is still only a very limited niche of the total audience. Most people do not vote or actively participate.

Demographics are way more complicated than they first appear. When I was a buyer for a bike shop, the numbers were surprising. Around 65% of my business was all entry level stuff even though all three shops were high end road race and XC. It is easy to believe one understands the audience, but in my experience I only really trust solid numbers and data.

That said, a reputation based system of social hierarchy exists already in academia.

You would need to assess the compromises involved too. Who is not going to post what because of this form of bias. I’m one of those people that will post lots of oddball stuff the piques my curiosity. I would like some engagement, but I don’t care or focus on posting stuff that everyone will like. If some bias takes away all of my engagement for some popularity metric, I migrate somewhere else. I find most popular content humdrum and uninteresting.

The issue is that people will use votes for if they like the thing or not instead of if it’s in good faith, even if you tell them not to, both on purpose to harm opposing views, and unintentionally because they’re more likely to notice a bad faith tactic coming from someone disagreeing than from someone agreeing with them.

I didn’t read your post, I just downvoted because I don’t like your username. Whatcha’ going to do about it?

(Jk, I picked the instance I joined based on the fact that it doesn’t do downvotes. I think downvotes drive perverse incentives)

Why do we need to know how many up or down votes a user has? Assholes usually make themselves known pretty quickly.

It’s just not that good of a metric overall. Not just because it would be easy to fake it, but also because it would inevitably divide into tribes that unconditionally upvote eachother. See: politics in western countries.

You can pile up a ton of reputation and still be an asshole and still get a ton of support from like-minded people.

The best measure of someone’s reputation is a quick glance and their post history.

One issue specific to the Fediverse is that each instance and each community might have its own standard for what it considers “credible”—and part of another user’s credibility score might come from users on instances with which yours isn’t federated and doesn’t share information.