Is the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/1306.5204/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTIs the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose — mentioned by Mathnerd314https://news.ycombinator.com/item?id=14700321urn:hackerpapers:mention:1306.5204:14700321Wed, 05 Jul 2017 06:32:21 GMT<p>The Twitter status sample (https://dev.twitter.com/streaming/reference/get/statuses/sam...) is a reasonably unbiased sample (https://arxiv.org/pdf/1306.5204.pdf). You&#x27;d have to learn 6 or 7 languages to really follow it, but there are some ways to filter it to English-only. Also useful is https://www.reddit.com/r/all/top/?sort=top&amp;t=day, a bit US/tech-biased but definitely a few million.</p><p><a href="https://hackerpaper.kaipfister.de/p/1306.5204/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.SI