Demystifying Verbatim Memorization in Large Language Models · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2407.17817/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTDemystifying Verbatim Memorization in Large Language Models — mentioned by ks2048https://news.ycombinator.com/item?id=42538257urn:hackerpapers:mention:2407.17817:42538257Sun, 29 Dec 2024 07:09:14 GMT<p>This is interesting. I&#x27;m curious about how much (and what) these LLMs memorize verbatim. Does anyone know any more thorough papers on this topic? For example, this could be tested on every verse in bible and lots of other text that is certainly in the training data: books in project gutenberg, wikipedia articles, etc. Edit: this (and its references) looks like a good place to start: https://arxiv.org/abs/2407.17817v1</p><p><a href="https://hackerpaper.kaipfister.de/p/2407.17817/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.CL