https://hackerpaper.kaipfister.de/p/2403.14123/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=41470771urn:hackerpapers:mention:2403.14123:41470771Sat, 07 Sep 2024 00:46:29 GMT<p>This paper is light on background so I’ll offer some additional context: As early as the 90s it was observed that CPU speed (FLOPs) was improving faster than memory bandwidth. In 1995 William Wulf and Sally Mckee predicted this divergence would lead to a “memory wall”, where most computations would be bottlenecked by data access rather than arithmetic operations. Over the past 20 years peak server hardware FLOPS has been scaling at 3x every 2 years, outpacing the growth of DRAM and interconnect bandwidth, which have only scaled at 1.6 and 1.4 times every 2 years, respectively. Thus for…</p><p><a href="https://hackerpaper.kaipfister.de/p/2403.14123/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.LG