https://hackerpaper.kaipfister.de/p/2505.08140/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=47372191urn:hackerpapers:mention:2505.08140:47372191Sat, 14 Mar 2026 01:06:21 GMT<p>It seems to be the hit rate of a very straightforward (literal matching) retrieval. Just checked the benchmark description (https://huggingface.co/datasets/openai/mrcr), here it is: &quot;The task is as follows: The model is given a long, multi-turn, synthetically generated conversation between user and model where the user asks for a piece of writing about a topic, e.g. &quot;write a poem about tapirs&quot; or &quot;write a blog post about rocks&quot;. Hidden in this conversation are 2, 4, or 8 identical asks, and the model is ultimately prompted to return the i-th instance of one of those asks. For example, &quot;Return…</p><p><a href="https://hackerpaper.kaipfister.de/p/2505.08140/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.AI