WinoGrande: An Adversarial Winograd Schema Challenge at Scale · HackerPapers discussions

WinoGrande: An Adversarial Winograd Schema Challenge at Scale — mentioned by mrconter11

Sun, 22 Dec 2024 13:47:15 GMT

Thank you for your reply. The time to human level is simply the time it took between the initial release of the website to when an AI system reached human level performance for that benchmark. :) I am in the process of adding sources for all "solved" dates... Here is for instance source for the Winograd challenge human level performance: https://arxiv.org/pdf/1907.10641#:~:text=The%20best%20state%...). :)

Paper and discussion history. A mention is not an endorsement.

WinoGrande: An Adversarial Winograd Schema Challenge at Scale — mentioned by YeGoblynQueenne

Sat, 14 Sep 2024 10:59:15 GMT

"Designed" is not right. What gives "AI models" (i.e. deep neural nets) a hard time is that there are very few examples in the public training and evaluation set: each task has three examples. So basically it's not a test of intelligence but a test of sample efficiency. Besides which, it is unfair because it excludes an entire category of systems, not to mention a dominant one. If F. Chollet really believes ARC is a test of intelligence, then why not provide enough examples for deep nets or some other big data approach to be trained effectively? The answer is: because a big data approach…

Paper and discussion history. A mention is not an endorsement.

WinoGrande: An Adversarial Winograd Schema Challenge at Scale — HN submission

Sat, 27 Jul 2019 00:36:33 GMT

Winogrande: An Adversarial Winograd Schema Challenge at Scale

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.