TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2402.13249/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTTofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization — mentioned by nicklecomptehttps://news.ycombinator.com/item?id=39767825urn:hackerpapers:mention:2402.13249:39767825Wed, 20 Mar 2024 15:18:21 GMT<p>They’re good at summarizing text convincingly if you didn’t read the original document, but GPT-4 still makes a ton of basic factual mistakes: https://arxiv.org/abs/2402.13249 I think it will be several decades - maybe longer - before you can throw an arbitrary 20-page document into a computer program and get an accurate one-page summary. People need to take seriously that transformer LLMs don’t understand human language.</p><p><a href="https://hackerpaper.kaipfister.de/p/2402.13249/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL