Omnigrok: Grokking Beyond Algorithmic Data — mentioned by cmorez

Sun, 22 Jan 2023 10:55:18 GMT

> Why do people say they don't now how it works "Curve Fitting" is the objective, the function encoded in the weights is the solution, and not actually well understood. See work from Anthropic[1] and Google[2] that explores this. As an analogy consider applying the same argument to the AlphaGo value function. It's "just" fitting a bunch of curves to the statistics of millions of self-played games. However, to effectively capture those statistics the network needed to develop a bunch of heuristics. Needless to say these heuristics are not understood (else we'd already know the principles…

Paper and discussion history. A mention is not an endorsement.

Omnigrok: Grokking Beyond Algorithmic Data · HackerPapers discussions

Omnigrok: Grokking Beyond Algorithmic Data — mentioned by cmorez