Understanding Data Storage and Ingestion for Large-Scale Deep Recommendation Model Training · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2108.09373/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTUnderstanding Data Storage and Ingestion for Large-Scale Deep Recommendation Model Training — mentioned by benreesmanhttps://news.ycombinator.com/item?id=39685337urn:hackerpapers:mention:2108.09373:39685337Tue, 12 Mar 2024 21:42:56 GMT<p>I think it’s always useful to pay attention to the history on stuff like this and it’s a rare pleasure to be able to give some pointers in the literature along with some color to those interested from first-hand experience. I’d point the interested at the DLRM paper [1]: that was just after I left and I’m sad I missed it. FB got into disagg racks and SDN and stuff fairly early, and we already had half-U dual-socket SKUs with the SSD and (increasingly) even DRAM elsewhere in the rack in 2018, but we were doing huge NNs for recommenders and rankers even for then. I don’t know if this is…</p><p><a href="https://hackerpaper.kaipfister.de/p/2108.09373/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.DC