General Intelligence Requires Rethinking Exploration — mentioned by visarga

Sun, 08 Jan 2023 12:13:43 GMT

There are two ways to learn: from imitation (language models are stochastic parrots) and from validation (problem solving, playing games). Many people only remember the first and forget the second. But the second one has the key to increasing intelligence. I don't know what the authors mean by "current algorithmic frame of AI research" because it is very diverse. But evolutionary methods work well with neural networks, they are not just next token predictors. > Evolution through Large Models https://arxiv.org/abs/2206.08896 It is true that simply using a dataset or a bunch of environments is…

Paper and discussion history. A mention is not an endorsement.

General Intelligence Requires Rethinking Exploration · HackerPapers discussions

General Intelligence Requires Rethinking Exploration — mentioned by visarga