AI and the Problem of Knowledge Collapse · HackerPapers discussions

AI and the Problem of Knowledge Collapse — mentioned by thesz

Mon, 09 Feb 2026 14:31:35 GMT

You are right about "LLM improving themselves" is impossible. In fact, LLM make themselves worse, it is called knowledge collapse [1]. [1] https://arxiv.org/abs/2404.03502

Paper and discussion history. A mention is not an endorsement.

AI and the Problem of Knowledge Collapse — mentioned by thesz

Thu, 23 Jan 2025 05:23:53 GMT

> Your domain is weird/rare, so LLMs are terrible because their training data is very limited. And this is how knowledge collapse [1] shows its' head. [1] https://arxiv.org/abs/2404.03502 I am not a big fan of LLMs so I try them once in a while, asking to "implement blocked clause decomposition in Haskell." They can recite a paper (and several other papers, with references) almost verbatim, but they do not posess enough comprehension of what is going on in these papers. As time passes by, with each new LLM, the level of comprehension drops. Last time LLM tried to persuade me to write code…

Paper and discussion history. A mention is not an endorsement.

AI and the Problem of Knowledge Collapse — mentioned by thesz

Tue, 21 Jan 2025 04:47:28 GMT

> trained the model on synthetic data You get knowledge collapse [1] this way. [1] https://arxiv.org/abs/2404.03502

Paper and discussion history. A mention is not an endorsement.

AI and the Problem of Knowledge Collapse — mentioned by thesz

Wed, 28 Aug 2024 09:53:41 GMT

> Its main purpose is to produce synthetic data for Orion, their next big LLM https://arxiv.org/abs/2404.03502 "This is generally useful, but widespread reliance on recursive AI systems could lead to a process we define as "knowledge collapse", and argue this could harm innovation and the richness of human understanding and culture... In our default model, a 20% discount on AI-generated content generates public beliefs 2.3 times further from the truth than when there is no discount."

Paper and discussion history. A mention is not an endorsement.

AI and the Problem of Knowledge Collapse — HN submission

Fri, 05 Apr 2024 19:30:30 GMT

AI and the Problem of Knowledge Collapse

189 points; 127 discussion replies on HN. Paper and source history. A submission is not an endorsement.