https://hackerpaper.kaipfister.de/p/2305.07141/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=40651993urn:hackerpapers:mention:2305.07141:40651993Tue, 11 Jun 2024 21:49:28 GMT<p>This claim that these tests are easy for humans seems dubious, and so I went looking a bit. Melanie Mitchell chimed in on Chollet&#x27;s thread and posted their related test [ConceptARC]. In it they question the ease of Chollet&#x27;s tests: &quot;One limitation on ARC’s usefulness for AI research is that it might be too challenging. Many of the tasks in Chollet’s corpus are difficult even for humans, and the corpus as a whole might be sufficiently difficult for machines that it does not reveal real progress on machine acquisition of core knowledge.&quot; ConceptARC is designed to be easier, but then also has to…</p><p><a href="https://hackerpaper.kaipfister.de/p/2305.07141/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.LGhttps://news.ycombinator.com/item?id=37660424urn:hackerpapers:submission:2305.07141:37660424Tue, 26 Sep 2023 15:03:23 GMT<p>The ConceptARC benchmark: Evaluating understanding and generalization</p><p></p><p>2 points; 0 discussion replies on HN. <a href="https://hackerpaper.kaipfister.de/p/2305.07141/">Paper and source history</a>. A submission is not an endorsement.</p>cs.LG