MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2502.06453/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTMATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations — mentioned by nopinsighthttps://news.ycombinator.com/item?id=43676897urn:hackerpapers:mention:2502.06453:43676897Mon, 14 Apr 2025 00:15:47 GMT<p>For the skeptics: Scoring just 10% or so in Math-Perturb-Hard below the original MATH Level 5 (hardest) dataset seems in line with or actually better than most people would do. Does that mean most people are merely parrots too? https://math-perturb.github.io/ https://arxiv.org/abs/2502.06453 Leaderboard: https://math-perturb.github.io/#leaderboard Anyone who continues to use the parrot metaphor should support it with evidence at least as strong as the “On the Biology of a Large Language Model” research by Anthropic which the article refers to…</p><p><a href="https://hackerpaper.kaipfister.de/p/2502.06453/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.LG