Survey of Hallucination in Natural Language Generation · HackerPapers discussions

Survey of Hallucination in Natural Language Generation — mentioned by intended

Mon, 26 Feb 2024 05:46:57 GMT

https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=llm+... https://www.medpagetoday.com/ophthalmology/generalophthalmol.... - Survey of Hallucination in Natural Language Generation](https://arxiv.org/abs/2202.03629) (Ji et al., 2022) - [How Language Model Hallucinations Can Snowball](https://arxiv.org/abs/2305.13534) (Zhang et al., 2023) - [A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity](https://arxiv.org/abs/2302.04023) (Bang et al., 2023) - [Contrastive Learning Reduces Hallucination in…

Paper and discussion history. A mention is not an endorsement.

Survey of Hallucination in Natural Language Generation — mentioned by williamcotton

Thu, 02 Mar 2023 20:46:25 GMT

Here you go, here's a bunch of papers that you have not read. If you had read them then you would know that the errors are predictable and therefore there are many measurable ways to make improvements. Toolformer: Language Models Can Teach Themselves to Use Tools: https://arxiv.org/abs/2302.04761 PAL: Program-aided Language Models: https://arxiv.org/abs/2211.10435 TALM: Tool Augmented Language Models: https://arxiv.org/abs/2205.12255 Chain-of-Thought Prompting Elicits Reasoning in Large Language Models: https://arxiv.org/abs/2201.11903 Survey of Hallucination in Natural Language Generation…

Paper and discussion history. A mention is not an endorsement.

Survey of Hallucination in Natural Language Generation — mentioned by williamcotton

Mon, 27 Feb 2023 21:21:27 GMT

If you're looking for academic research, this is a great place to start: https://arxiv.org/abs/2202.03629 But you can get a general feel by using ChatGPT. Open up a new conversation and ask it something like, "What is the capital of France?". Note the response. Open up a new conversation and note the response. Soon enough you should be able to see that the responses are far from random. You can use the OpenAI APIs directly and have it run 10,000 or so iterations to see what kind of "hallucinations" it makes! They are not random!

Paper and discussion history. A mention is not an endorsement.

Survey of Hallucination in Natural Language Generation — mentioned by eternalban

Mon, 13 Feb 2023 19:29:53 GMT

It's a technical term: Survey of Hallucination in Natural Language Generation (2022): https://arxiv.org/abs/2202.03629 From source: "Once again, intrinsic hallucination refers to output content that contradicts the source, while extrinsic hallucination refers to output content that the source cannot verify."

Paper and discussion history. A mention is not an endorsement.