Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States — mentioned by cornel_io

Thu, 20 Mar 2025 05:09:37 GMT

There are various results that suggest that LLMs do internally have everything they'd need to know that they're hallucinating/wrong: https://arxiv.org/abs/2402.09733 https://arxiv.org/abs/2305.18248 https://www.ox.ac.uk/news/2024-06-20-major-research-hallucin... So I don't think it's that they have no concept of correctness, they do, but it's not strong enough. We're probably just not training them in ways that optimize for that over other desirable qualities, at least aggressively enough. It's also clear to anyone who has used many different models over the years that the amount of…

Paper and discussion history. A mention is not an endorsement.

Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States · HackerPapers discussions

Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States — mentioned by cornel_io