The Elephant in the Room · HackerPapers discussions

The Elephant in the Room — mentioned by YeGoblynQueenne

Mon, 07 Mar 2022 13:45:19 GMT

[NOT THE OP] >> All you see is numbers and functions, and all I see is problems being solved by these AI/ML methods and often in quantifiably better ways than intelligent humans can. Maybe in playing chess and go, but in any other task that neural networks have been compared to humans directly, the ability to outperform humans is more informative of the limitations of the measures of performance, than of the capabilities of the tested systems (typically, deep neural networks). Take large language models (LLMs) for example. Last time I looked -it was a while ago but- LLMs like BERT, ERNIE and…

Paper and discussion history. A mention is not an endorsement.

The Elephant in the Room — mentioned by YeGoblynQueenne

Fri, 07 Jan 2022 18:56:11 GMT

With the exception of counterfactual regret minimisation, which has nothing to do with deep learning, all those are applications of existing approaches that have become possible because of the increased expenditure of resources- processing power and data. There have been no theoretical advances, no algorithmic advances to speak of, no new knowledge learned in the last 20 years of reserach in deep learning. All that has been achieved is new SOTA on old benchmarks [1]. To make an analogy it's as if we could sort ever larger lists because we keep sorting them with ever bigger computers... but…

Paper and discussion history. A mention is not an endorsement.

The Elephant in the Room — mentioned by YeGoblynQueenne

Thu, 09 Jul 2020 23:20:17 GMT

>> AI as a field relied mostly on 'understanding' based approaches for 50 years without much success. These approaches were too brittle and ungrounded. Why return to something that doesn't work? To begin with, because they do work and much better than the new approaches in a range of domains. For example, classical planners, automated theorem provers and SAT solvers are still state-of-the-art for their respective problem domains. Statistical techniques can not do any of those things very well, if at all. Further, because the newer techniques have proven to also be brittle in their own way.…

Paper and discussion history. A mention is not an endorsement.

The Elephant in the Room — HN submission

Mon, 03 Sep 2018 21:19:23 GMT

The Elephant in the Room

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

The Elephant in the Room — HN submission

Mon, 27 Aug 2018 15:09:47 GMT

The Elephant in the Room [pdf]

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.