Mesh-TensorFlow: Deep Learning for Supercomputers · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/1811.02084/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTMesh-TensorFlow: Deep Learning for Supercomputers — HN submissionhttps://news.ycombinator.com/item?id=26534463urn:hackerpapers:submission:1811.02084:26534463Sun, 21 Mar 2021 21:53:32 GMT<p>Mesh-TensorFlow: Deep Learning for Supercomputers</p><p></p><p>2 points; 0 discussion replies on HN. <a href="https://hackerpaper.kaipfister.de/p/1811.02084/">Paper and source history</a>. A submission is not an endorsement.</p>cs.LGMesh-TensorFlow: Deep Learning for Supercomputers — mentioned by riku_ikihttps://news.ycombinator.com/item?id=19174746urn:hackerpapers:mention:1811.02084:19174746Fri, 15 Feb 2019 21:10:14 GMT<p>I doubt 1.5B params will fit any single GPU. I think they spread parts of models between GPUs/TPUs similarly to mesh-tensorflow: https://arxiv.org/abs/1811.02084</p><p><a href="https://hackerpaper.kaipfister.de/p/1811.02084/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.LG