FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2303.06865/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:27:26 GMTFlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU — HN submissionhttps://news.ycombinator.com/item?id=35146081urn:hackerpapers:submission:2303.06865:35146081Tue, 14 Mar 2023 01:29:01 GMT<p>High-Throughput Generative Inference of Large Language Models with a Single GPU</p><p></p><p>116 points; 36 discussion replies on HN. <a href="https://hackerpaper.kaipfister.de/p/2303.06865/">Paper and source history</a>. A submission is not an endorsement.</p>cs.LG