Language models are better than humans at next-token prediction — mentioned by famouswaffles

Wed, 17 May 2023 17:11:28 GMT

LLMs reached super-human ability on their task long ago. Everything else is a nice side quest. https://arxiv.org/abs/2212.11281

Paper and discussion history. A mention is not an endorsement.

Language models are better than humans at next-token prediction — mentioned by famouswaffles

Tue, 16 May 2023 12:14:21 GMT

>You also literally said that: > We already know that the higher the parameter count, the lower the training data required >And if you scroll up a bit, you'll see that this was the assertion that I've been questioning since the beginning. They follow each other. If you have a target in mind, it's the same thing in different words. >AFAIK, there's no reason to believe that the current architecture of LLM scaled to 100 trillions of parameters would be able to be trained efficiently on just a few millions of token like humans I didn't say it was a given. And in my original comment , I say as…

Paper and discussion history. A mention is not an endorsement.

Language models are better than humans at next-token prediction · HackerPapers discussions

Language models are better than humans at next-token prediction — mentioned by famouswaffles

Language models are better than humans at next-token prediction — mentioned by famouswaffles