https://hackerpaper.kaipfister.de/p/2205.14217/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMThttps://news.ycombinator.com/item?id=43131724urn:hackerpapers:mention:2205.14217:43131724Fri, 21 Feb 2025 19:20:45 GMT<p>Thanks for bringing this up! As far as I understand it current text diffusion models are limited to fairly short context windows. The idea of a text diffusion model continuously updating and revising a million-token-long chain-of-thought is pretty mind-boggling. I agree that these non-autoregressive models could potentially behave in completely different ways. That said, I&#x27;m pretty sure we&#x27;re a long way from building equally-competent diffusion-based base models, let alone reasoning models. If anyone&#x27;s interested in this topic, here are some more foundational papers to take a look at…</p><p><a href="https://hackerpaper.kaipfister.de/p/2205.14217/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL