arXiv:2210.15723cs.SI
Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation
Abstract
We present an approach for selecting objectively informative and subjectively helpful annotations to social media posts. We draw on data from on an online environment where contributors annotate misinformation and simultaneously rate the contributions of others. Our algorithm uses a matrix-factorization (MF) based approach to identify annotations that appeal broadly across heterogeneous user groups - sometimes referred to as "bridging-based ranking." We pair these data with a survey experiment in which individuals are randomly assigned to see annotations to posts. We find that annotations selected by the algorithm improve key indicators compared with overall average and crowd-generated baselines. Further, when deployed on Twitter, people who saw annotations selected through this bridging-based approach were significantly less likely to reshare social media posts than those who did not see the annotations.
Here's the Community Notes whitepaper [1], for how it all works. Previous discussion [2]. [1] Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation, https://arxiv.org/abs/2210.15723 [2]…
nomelView on HNParent context
> Community notes are just opinions of random people on internet It's much more complicated than that. Here's the white paper: https://arxiv.org/abs/2210.15723
nomelView on HNParent context
A way to quantify this doesn't immediately come to my mind. Maybe reasonable metrics would be: 1. What % misleading/false posts are flagged 2. What % of those flagged are given meaningful context/corrections that are accurate. It seems there's circular logic of first determining…
nomelView on HNParent context