https://hackerpaper.kaipfister.de/p/2003.07278/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=38511464urn:hackerpapers:mention:2003.07278:38511464Sun, 03 Dec 2023 22:36:04 GMT<p>As a prerequisite to the attention paper? One to check out is: A Survey on Contextual Embeddings https://arxiv.org/abs/2003.07278 Embeddings are sort of what all this stuff is built on so it should help demystify the newer papers (it’s actually newer than the attention paper but a better overview than starting with the older word2vec paper). Then after the attention paper an important one is: Language Models are Few-Shot Learners https://arxiv.org/abs/2005.14165 I’m intentionally trying to not give a big list because they’re so time-consuming. I’m sure you’ll quickly branch out based on your…</p><p><a href="https://hackerpaper.kaipfister.de/p/2003.07278/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL