https://hackerpaper.kaipfister.de/p/2409.13740/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=43446862urn:hackerpapers:mention:2409.13740:43446862Sat, 22 Mar 2025 16:28:05 GMT<p>Do you have ideas for what would make a better experiment? The methodology for a literature search comparison, while simple, is the best I could come up with. We developed ~250 multiple choice questions which require a deep dive into a paper to answer, ideally with very convincing distractor answers. Then we gave 9 evaluators (post-docs and grad students in biology) a week to answer 40 questions each, without any limitations on their search. The evaluators were incentivized by providing a base pay per question completed, with a 50-100% bonus if they got enough questions correct. Under those…</p><p><a href="https://hackerpaper.kaipfister.de/p/2409.13740/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CLhttps://news.ycombinator.com/item?id=42140356urn:hackerpapers:submission:2409.13740:42140356Thu, 14 Nov 2024 19:46:19 GMT<p>Language agents achieve superhuman synthesis of scientific knowledge</p><p></p><p>54 points; 22 discussion replies on HN. <a href="https://hackerpaper.kaipfister.de/p/2409.13740/">Paper and source history</a>. A submission is not an endorsement.</p>cs.CL