Difference between revisions of "Peer-to-Peer Accountability Enforcement"

From InstaGov
Jump to navigation Jump to search
(→‎Notes: Tribler uses this basic principle)
(layout tweaks)
 
(16 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
==Purpose==
+
==About==
−
It is easy for malicious, misinformed, and uncomprehending users to greatly reduce the efficacy of civil discussion. I'll refer to these collectively as "malusers" for now, although the majority are probably not deliberately or knowingly malicious.
+
[[Peer-to-Peer Accountability Enforcement]] is a methodology for sharply reducing the problem of posting content in bad faith (including both outright verbal abuse as well as abuses that are harder to spot, such as {{l/ip|sea-lioning}}) by allowing users to collectively delegate other trusted users to rate comments and commenters as to their credibility and appropriateness. It generally increases per-user accountability for abuse, but with the source of that accountability being other users rather than a central authority (with all the bottlenecking and [[power-concentration]] that implies).
−
 
+
==Pages==
−
Malusers generally fall into one or more of the following groups:
+
<big>
−
* [[issuepedia:discussion troll|troll]]s
+
* '''{{l/sub|purpose}}''' - this needs to be a bit more general
−
* astroturfers
+
* '''{{l/sub|mechanism}}''' - the quasi-technical details
−
* propaganda victims
+
</big>
−
 
+
==Notes==
−
The involvement of individual malusers in a discussion frequently has the following adverse effects:
+
Things that credibility management ''should'' be able to defeat or at least control:
−
* throwing the conversation off-topic
+
* [[sea-lioning]] (see {{issuepedia|sea-lioning}}): appears civil and polite on the surface, so may be difficult to judge without understanding the full context
−
* injecting false but believable information
+
* [[brigading]] -- though it may take a combination of credibility management and [[debate mapping]]:
−
* making false claims that require extensive research to refute
+
** '''2015-07-17''' [http://freethoughtblogs.com/pharyngula/2015/07/17/there-are-good-reasons-ive-never-been-a-fan-of-reddit/ There are good reasons I’ve never been a fan of Reddit]
−
* failing to understand the arguments of others
+
* [[evaporative cooling]]:
−
 
+
** '''2010-10-10''' [http://blog.bumblebeelabs.com/social-software-sundays-2-the-evaporative-cooling-effect/ Social Software Sundays #2 – The Evaporative Cooling Effect]
−
It should be noted that many malusers are known for being unreasonable only on specific topics, and entirely reasonable on others.
+
* [[click-farming]] ...except I'm not understanding the value of having fake followers:
−
 
+
** '''2015-04-20''' [http://www.newrepublic.com/article/121551/bot-bubble-click-farms-have-inflated-social-media-currency How Click Farms Have Inflated Social Media Currency]
−
While blocking and banning (currently supported by most social media venues) are generally effective ways of dealing with malusers when they are identified, those techniques have a number of shortcomings:
+
*** private discussion [https://plus.google.com/u/0/104092656004159577193/posts/MGmWGw3vUBx here]
−
* it is too easy to block someone who is making valid arguments that you happen to disagree with
+
* [[online harassment]]
−
* blocking is fundamentally hierarchical:
+
** '''2014-10-09''' [http://www.theatlantic.com/technology/archive/2014/10/the-unsafety-net-how-social-media-turned-against-women/381261/ The Unsafety Net: How Social Media Turned Against Women] ([https://plus.google.com/u/0/+CindyBrown/posts/8Ahnx7mVciy via])
−
** one person owns a thread or post, and has the sole authority to block individuals from commenting on it
 
−
** a group of admins have the sole authority to ban individuals from posting in that group; there is also typically a single owner or founder who can demote or block admins
 
−
* blocking is a very crude level of control:
 
−
** typically, the only way to block someone from posting on a given thread is a person-to-person block -- preventing the two of you from seeing ''anything'' said by the other
 
−
** blocking someone from posting in a group prevents them from participating in ''any'' discussions in that group, including topics on which they are more reasonable
 
−
* once blocked, there is no reliable process by which a reformed maluser can regain posting permission
 
−
 
 
−
A better solution is needed.
 
−
==Proposal==
 
−
Improved control over malusers requires both finer granularity in the blocking system and a more even-handed, less-centralized way of deciding who needs to be restricted.
 
−
 
 
−
The following mechanisms should address most or all of the above shortcomings. In particular, the process of allowing a given user A to avoid posts by user B based ''only'' on the ratings of ''other users explicitly trusted by A'' should help to overcome bias and snap judgements.
 
−
 
 
−
While it could still be not especially difficult for a user to create their own personal "echo chamber" under this system, it would be notably less easy than existing systems where any user has complete control over who they block -- and would become progressively more difficult the more people one "trusts". This should help to limit the damage done by attempts at [[issuepedia:epistemic closure|epistemic closure]].
 
−
===Crowdsourced Ratings===
 
−
This is a sort of minimum specification; many refinements and elaborations are possible. Experimentation will determine what works best.
 
−
 
 
−
* Every user can rate every other user's credibility on a numeric scale (e.g. integers from -10 to +10).
 
−
* For each pair of users A and B, where A wants to know B's credibility, a '''Personal Credibility Rating (PCR)''' is calculated as follows:
 
−
** For every user C who has been given a positive rating by A (ArC) and who has rated B (CrB), the system sums all (ArC/10 x CrB/10) to produce a single number which represents, essentially, "what my friends think of this person".
 
−
** If the number of such ratings is too few, the resulting rating may be displayed in faint colors or with some other indication that it is tentative.
 
−
 
 
−
===Personalized Credibility Rating===
 
−
Personalized Credibility Rating, or PCR, is my term for a way of tracking each user's credibility in the eyes of others.
 
  
−
It's built on a user-voting basis such as those in used on sites such as [[wikipedia:Reddit|Reddit]], but with some refinements:
 
−
* uses range (non-binary) voting
 
−
* summing is personalized for each user, rather than being global
 
−
 
−
Here's how it would work. (For the sake of brevity, I'll use "post" to mean anything posted by one user for others to see, regardless of whether it's a root-level post or a comment on a post.)
 
−
 
−
* Each post has its own PCR that is separate from the PCR of the user who posted it.
 
−
* The PCR for any given post will ''default'' to the poster's PCR.
 
−
* Any additional post-specific ratings will modify that post's PCR by some sort of weighted average.
 
−
** Experimentation will be needed to determine the best algorithm, but we could start by weighting the poster's PCR by how many individual ratings went into it.
 
−
* Each user X only sees posts whose PCR exceeds X's Minimum Required Credibility (MRC -- see below).
 
−
* Each user X may adjust the [[#Frequency of Notification]] at various levels above their MRC.
 
−
* Each user X starts with a default global MRC, but they may modify that default and they may also set specific MRCs for individual threads or groups.
 
−
* All users can rate each post's credibility.
 
−
* Optional: ratings of users' posts could have some small, cumulative influence on their overall PCR. Perhaps the influence of any given user A's ratings of B's posts should be overridden whenever they revise their overall rating of B. Experimentation needed.
 
−
 
−
"MRC" refers to a setting that each user can adjust to determine the strength of post-filtering. The lower it is, the more posts they'll see -- because they'll be allowing less-credible posts through. The higher it is, the higher-credibility a post has to have in order to be visible. (There will presumably be other user-options to determine how "hidden" posts are indicated -- e.g. a summary showing how many, a list of usernames, etc.)
 
−
 
−
===Frequency of Notification===
 
−
Rather than simply blocking those whose PCR falls below a threshhold, users can "distance" themselves from other users by selecting how often they wish to be notified of posts based on the poster's PCR (and possibly how often they wish for ''their'' posts to generate notifications to that other user).
 
−
 
−
For example, if I see user A with a high PCR and user B with a low PCR, I might want to be notified immediately whenever user A posts, but only every week regarding user B's posts. (Similarly, I might want to avoid notifying user B right away if I respond, in order to further reduce the amount of time I spend interacting with them.)
 
−
 
−
This would promote higher engagement between higher-value users without completely excluding others from the dialogue.
 
−
 
−
Note that this is different from the random-selective notification of social networks such as Facebook and Google+, where some posts are simply ignored. (The latter system may require substantially less computing power; a data design for a FoN system has not yet been worked out.) All posts are eventually included in a notification, but may be time-delayed and grouped with other posts by the same user.
 
−
==Notes==
 
 
Credibility management is beginning to look potentially useful for rating subjective quality of aesthetic works. Some discussion of that application is here:
 
Credibility management is beginning to look potentially useful for rating subjective quality of aesthetic works. Some discussion of that application is here:
 
* '''2014-06-20''' [http://www.reddit.com/r/dredmorbius/comments/28jfk4/content_rating_moderation_and_ranking_systems/ Content rating, moderation, and ranking systems: some non-brief thoughts] (Edward Morbius).
 
* '''2014-06-20''' [http://www.reddit.com/r/dredmorbius/comments/28jfk4/content_rating_moderation_and_ranking_systems/ Content rating, moderation, and ranking systems: some non-brief thoughts] (Edward Morbius).
 
** Related: '''2014-09-21''' [http://www.reddit.com/r/dredmorbius/comments/2h0h81 Specifying a Universal Online Media Payment Syndication System]
 
** Related: '''2014-09-21''' [http://www.reddit.com/r/dredmorbius/comments/2h0h81 Specifying a Universal Online Media Payment Syndication System]
 
*** which was a sequel to: '''2014-01-08''' [http://www.reddit.com/r/dredmorbius/comments/1uotb3/a_modest_proposal_universal_online_media_payment/# A Modest Proposal: Universal Online Media Payment Syndication]
 
*** which was a sequel to: '''2014-01-08''' [http://www.reddit.com/r/dredmorbius/comments/1uotb3/a_modest_proposal_universal_online_media_payment/# A Modest Proposal: Universal Online Media Payment Syndication]
−
* '''2012-02-10''' [http://www.smartplanet.com/blog/thinking-tech/piracy-now-unstoppable-new-file-sharing-network-cant-be-shut-down/ Piracy now unstoppable? New file-sharing network can't be shut down] "Where most torrent sites have a team of moderators to delete viruses, malware and fake files, Tribler '''uses crowd-sourcing to keep the network clean.''' Content is verified by user generated “channels”, which can be “liked” by others. When more people like a channel, the associated torrents get a boost in the search results."
+
* '''2012-02-08''' [http://torrentfreak.com/tribler-makes-bittorrent-impossible-to-shut-down-120208/ Tribler Makes BitTorrent Impossible to Shut Down] ([http://www.smartplanet.com/blog/thinking-tech/piracy-now-unstoppable-new-file-sharing-network-cant-be-shut-down/ via]) "Where most torrent sites have a team of moderators to delete viruses, malware and fake files, Tribler '''uses crowd-sourcing to keep the network clean.''' Content is verified by user generated “channels”, which can be “liked” by others. When more people like a channel, the associated torrents get a boost in the search results."
 +
* '''2011-02-05''' [http://www.quora.com/What-is-Quoras-algorithm-formula-for-determining-the-ordering-ranking-of-answers-on-a-question What is Quora's algorithm/formula for determining the ordering/ranking of answers on a question?]: this is a similar concept on the surface, but lacks some important elements:
 +
** no proxying/layering -- all ratings are direct
 +
** no personalized credibility ratings (PCRs)
 +
** minimal granularity, i.e. only two possible values (-1/+1) for each ranking

Latest revision as of 12:25, 3 May 2021

About

Peer-to-Peer Accountability Enforcement is a methodology for sharply reducing the problem of posting content in bad faith (including both outright verbal abuse as well as abuses that are harder to spot, such as sea-lioning) by allowing users to collectively delegate other trusted users to rate comments and commenters as to their credibility and appropriateness. It generally increases per-user accountability for abuse, but with the source of that accountability being other users rather than a central authority (with all the bottlenecking and power-concentration that implies).

Pages

  • purpose - this needs to be a bit more general
  • mechanism - the quasi-technical details

Notes

Things that credibility management should be able to defeat or at least control:

Credibility management is beginning to look potentially useful for rating subjective quality of aesthetic works. Some discussion of that application is here:

Retrieved from "https://instagov.com/wiki/index.php?title=Peer-to-Peer_Accountability_Enforcement&oldid=12497"