https://hackerpaper.kaipfister.de/p/2411.04872/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=43027117urn:hackerpapers:mention:2411.04872:43027117Wed, 12 Feb 2025 16:49:02 GMT<p>Tested in the article: miniF2F: https://github.com/openai/miniF2F PutnamBench: https://github.com/trishullab/PutnamBench .. FrontierMath: https://arxiv.org/abs/2411.04872v1</p><p><a href="https://hackerpaper.kaipfister.de/p/2411.04872/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.AIhttps://news.ycombinator.com/item?id=42489238urn:hackerpapers:mention:2411.04872:42489238Sun, 22 Dec 2024 21:24:03 GMT<p>When can infer somewhat from this section in the FrontierMath paper [1]: &quot;Assessment of FrontierMath difficulty All four mathematicians characterized the research problems in the FrontierMath benchmark as exceptionally challenging, noting that the most difficult questions require deep domain expertise and significant time investment. For example, referring to a selection of several questions from the dataset, Tao remarked, &quot;These are extremely challenging. I think that in the near term basically the only way to solve them, short of having a real domain expert in the area, is by a combination…</p><p><a href="https://hackerpaper.kaipfister.de/p/2411.04872/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.AIhttps://news.ycombinator.com/item?id=42171222urn:hackerpapers:mention:2411.04872:42171222Mon, 18 Nov 2024 10:30:42 GMT<p>There&#x27;s the Frontier Math benchmarks [0] demonstrating that AI is currently quite far from human performance at research-level mathematics. [0] https://arxiv.org/abs/2411.04872</p><p><a href="https://hackerpaper.kaipfister.de/p/2411.04872/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.AIhttps://news.ycombinator.com/item?id=42097683urn:hackerpapers:mention:2411.04872:42097683Sun, 10 Nov 2024 00:01:41 GMT<p>ScholarlyArticle: &quot;FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI&quot; (2024) https://arxiv.org/abs/2411.04872 .. https://epochai.org/frontiermath/the-benchmark : &gt; [Not even 2%] &gt; Abstract: We introduce FrontierMath, a benchmark of hundreds of original, exceptionally challenging mathematics problems crafted and vetted by expert mathematicians. The questions cover most major branches of modern mathematics -- from computationally intensive problems in number theory and real analysis to abstract questions in algebraic geometry and category theory. Solving a typical…</p><p><a href="https://hackerpaper.kaipfister.de/p/2411.04872/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.AI