What is New in Stochastic Rounding: a Survey on Theory, Hardware, and Applications · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2603.06060/Collected HN comments and submissions linking this paper.enThu, 05 Nov 2026 05:34:29 GMTWhat is New in Stochastic Rounding: a Survey on Theory, Hardware, and Applications — mentioned by martincsweisshttps://news.ycombinator.com/item?id=50374271urn:hackerpapers:mention:2603.06060:50374271Thu, 05 Nov 2026 02:17:10 GMT<p>Yep, Stochastic Rounding [1]. I actually had &quot;round-to-nearest&quot; in the title of the piece originally. Usually people do that if they don&#x27;t have the space for fp32 master weights, but it doesn&#x27;t fix the second moment part of the learning process. [1] What is New in Stochastic Rounding: a Survey on Theory, Hardware, and Applications, https://arxiv.org/pdf/2603.06060v2</p><p><a href="https://hackerpaper.kaipfister.de/p/2603.06060/">Paper and discussion history</a>. A mention is not an endorsement.</p>math.NA