https://hackerpaper.kaipfister.de/p/2006.04643/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=24246738urn:hackerpapers:mention:2006.04643:24246738Sat, 22 Aug 2020 19:46:12 GMT<p>I keep wanting to write a long explanation of just why this is so... silly? to read? But Gwern has already done the hard work. [0] The only other bit I&#x27;d like to mention is that GPT-3 uses exactly none of the new techniques that have been coming out in the last two years that would have significant impact on text generation. From working methods to apply GANs to text, to far more efficient transformer models that can handle longer sequences. For instance [1] [2] [3] for better direction, or [4] [5] [6] for efficiency. Or perhaps the outside view might help. After seeing GPT-2 last year, did…</p><p><a href="https://hackerpaper.kaipfister.de/p/2006.04643/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL