Large Language Models Struggle to Learn Long-Tail Knowledge · HackerPapers discussions

Large Language Models Struggle to Learn Long-Tail Knowledge — HN submission

Tue, 30 Dec 2025 10:32:37 GMT

Large Language Models Struggle to Learn Long-Tail Knowledge (2023)

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Large Language Models Struggle to Learn Long-Tail Knowledge — mentioned by pms

Fri, 24 Mar 2023 01:49:25 GMT

Have you provided the visual novel as a prompt or just asked about it? ChatGPT does seem to know more about books than songs, maybe because they are more often described in texts, while songs not, not sure. I wished more parameters gave a generalizable solution, but research suggests that's not the case [1, 2, 3]. OpenAI won't tell you this, cause they have a product to sell. [1] http://arxiv.org/abs/2211.08411 [2] http://arxiv.org/abs/2011.03395 [3] http://arxiv.org/abs/2005.04345

Paper and discussion history. A mention is not an endorsement.

Large Language Models Struggle to Learn Long-Tail Knowledge — HN submission

Wed, 16 Nov 2022 21:22:31 GMT

Large language models struggle to learn long-tail knowledge

27 points; 2 discussion replies on HN. Paper and source history. A submission is not an endorsement.