LaMsS: When Large Language Models Meet Self-Skepticism — mentioned by cma

Wed, 23 Apr 2025 05:59:45 GMT

Hallucinations heavily are correlated with poor performance on factual benchmarks, or at least I was referring to hallucinating false facts it was never trained on. There's a subset of hallucinations though where it hallucinates real factual things that weren't in the context as if they were there, but I think reasoning models improve on those since they deal with much longer strings of thought than typical internet fare, but maybe that's wrong. Deepseek reported heavily improved long context benchmark performance in r1 vs v3. You could characterize "did needle occur in haystack of text?…

Paper and discussion history. A mention is not an endorsement.

LaMsS: When Large Language Models Meet Self-Skepticism · HackerPapers discussions

LaMsS: When Large Language Models Meet Self-Skepticism — mentioned by cma