SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models · HackerPapers discussions

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models — mentioned by gmerc

Mon, 24 Jun 2024 04:22:33 GMT

This seems to do the same as this paper from last year but getting more press. https://arxiv.org/abs/2303.08896

Paper and discussion history. A mention is not an endorsement.

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models — mentioned by gmerc

Sat, 01 Jun 2024 09:07:45 GMT

Prediction implies inaccuracy https://arxiv.org/abs/2303.08896

Paper and discussion history. A mention is not an endorsement.

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models — mentioned by intended

Mon, 26 Feb 2024 05:46:57 GMT

https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=llm+... https://www.medpagetoday.com/ophthalmology/generalophthalmol.... - Survey of Hallucination in Natural Language Generation](https://arxiv.org/abs/2202.03629) (Ji et al., 2022) - [How Language Model Hallucinations Can Snowball](https://arxiv.org/abs/2305.13534) (Zhang et al., 2023) - [A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity](https://arxiv.org/abs/2302.04023) (Bang et al., 2023) - [Contrastive Learning Reduces Hallucination in…

Paper and discussion history. A mention is not an endorsement.

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models — mentioned by famouswaffles

Wed, 27 Sep 2023 04:31:06 GMT

https://arxiv.org/abs/2305.18248 "In particular, we find that LMs often hallucinate differing authors of hallucinated references when queried in independent sessions, while consistently identify authors of real references. This suggests that the hallucination may be more a generation issue than inherent to current training techniques or representation." https://arxiv.org/abs/2303.08896 "SelfCheckGPT leverages the simple idea that if a LLM has knowledge of a given concept, sampled responses are likely to be similar and contain consistent facts. However, for hallucinated facts, stochastically…

Paper and discussion history. A mention is not an endorsement.

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models — mentioned by famouswaffles

Wed, 27 Sep 2023 04:30:29 GMT

automatically comparing drafts for every single query would be expensive. and that wouldn't eliminate hallucinations just tell you if large details have likely been hallucinated. But it's a method some research has used. https://arxiv.org/abs/2303.08896

Paper and discussion history. A mention is not an endorsement.