Demon: Improved Neural Network Training with Momentum Decay · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/1910.04952/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTDemon: Improved Neural Network Training with Momentum Decay — mentioned by jonbaerhttps://news.ycombinator.com/item?id=32010647urn:hackerpapers:mention:1910.04952:32010647Thu, 07 Jul 2022 06:40:44 GMT<p>What is the current SOTA? Demon Adam? https://arxiv.org/pdf/1910.04952v4.pdf</p><p><a href="https://hackerpaper.kaipfister.de/p/1910.04952/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.LG