Deep Grokking: Would Deep Neural Networks Generalize Better? — mentioned by HarHarVeryFunny

Tue, 04 Jun 2024 00:38:37 GMT

There's a recent paper here where they've seen in a deeper model. https://arxiv.org/abs/2405.19454 It's a bit surprising that apparently this hasn't been done before - to see how universal of a phenomenon this is.

Paper and discussion history. A mention is not an endorsement.

Deep Grokking: Would Deep Neural Networks Generalize Better? · HackerPapers discussions

Deep Grokking: Would Deep Neural Networks Generalize Better? — mentioned by HarHarVeryFunny