Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior — mentioned by charleshmartin

Tue, 13 Nov 2018 18:39:30 GMT

I would say “Understanding Deep Learning Requires REMEMBERING Generalization” https://calculatedcontent.com/2018/04/01/rethinking-or-remem... https://arxiv.org/abs/1710.09553 We can understand this using the traditional theory of Statistical Mechanics of Generalization Briefly, shuffling the labels corresponds to decreasing the effective load on the Neural Network, which pushes the system into the spin glass phase

Paper and discussion history. A mention is not an endorsement.

Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior · HackerPapers discussions

Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior — mentioned by charleshmartin