Self-Consistency Improves Chain of Thought Reasoning in Language Models · HackerPapers discussions

Self-Consistency Improves Chain of Thought Reasoning in Language Models — mentioned by rush86999

Sun, 23 Aug 2026 23:38:54 GMT

Reasoning / self-consistency (voter in core/llm/self_consistency_voter.py): - Wang et al. Self-Consistency Improves Chain-of-Thought — ICLR 2023, Google Brain, 4k+ cites — https://arxiv.org/abs/2203.11171 — N-sample majority vote we use verbatim - Chen et al. Universal Self-Consistency — ICML 2024 — https://arxiv.org/abs/2311.17311 — judge fallback when no hash collides - Soft Self-Consistency — ACL 2024 — https://aclanthology.org/2024.acl-short.28.pdf - Too Consistent to Detect — EMNLP 2025 — https://aclanthology.org/2025.emnlp-main.238/ — why SC doesn't fix systematic bias…

Paper and discussion history. A mention is not an endorsement.

Self-Consistency Improves Chain of Thought Reasoning in Language Models — mentioned by stephenbez

Sun, 22 Feb 2026 07:54:08 GMT

Thanks. Are there any links where I can learn more about this? I did some Googling and it appears that there are some examples where people say combining multiple models or multiple runs of the same models leads to improvements: https://www.sciencedirect.com/science/article/abs/pii/S00104... https://arxiv.org/abs/2203.11171 But presumably people are less likely to publish a paper when an approach doesn’t work.

Paper and discussion history. A mention is not an endorsement.

Self-Consistency Improves Chain of Thought Reasoning in Language Models — mentioned by andai

Fri, 11 Apr 2025 16:34:55 GMT

Edit: It has a name! https://arxiv.org/abs/2203.11171

Paper and discussion history. A mention is not an endorsement.

Self-Consistency Improves Chain of Thought Reasoning in Language Models — mentioned by intended

Mon, 26 Feb 2024 05:46:57 GMT

https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=llm+... https://www.medpagetoday.com/ophthalmology/generalophthalmol.... - Survey of Hallucination in Natural Language Generation](https://arxiv.org/abs/2202.03629) (Ji et al., 2022) - [How Language Model Hallucinations Can Snowball](https://arxiv.org/abs/2305.13534) (Zhang et al., 2023) - [A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity](https://arxiv.org/abs/2302.04023) (Bang et al., 2023) - [Contrastive Learning Reduces Hallucination in…

Paper and discussion history. A mention is not an endorsement.

Self-Consistency Improves Chain of Thought Reasoning in Language Models — mentioned by dingocat

Sat, 02 Sep 2023 13:12:52 GMT

I have multiple questions regarding the methods of this test. The biggest one is that, well... The test doesn't aim to see what GPT-4 can do and how well it does it, only whether the participant can guess the (possibly cherry-picked) answer the author decided on. In short, we don't know if he sampled answers and decided on the most probable answer (akin to consensus voting/self-consistency[1]), or if he asked a question and chose the first one. Maybe GPT-4 guesses the correct answer for a question 80% of the time, but he got unlucky? You don't know, the author doesn't tell you. The answers…

Paper and discussion history. A mention is not an endorsement.

Self-Consistency Improves Chain of Thought Reasoning in Language Models — mentioned by ctoth

Tue, 29 Mar 2022 17:46:27 GMT

I believe this recent paper demonstrates a method for allowing these large language models to perform this "sanity check" automatically[0]. [0]: Self-Consistency Improves Chain of Thought Reasoning in Language Models https://arxiv.org/abs/2203.11171

Paper and discussion history. A mention is not an endorsement.