Causal Reasoning and Large Language Models: Opening a New Frontier for Causality · HackerPapers discussions

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — mentioned by famouswaffles

Tue, 11 Jul 2023 20:06:02 GMT

>I doubt it, but according the the article, it's reasonable to assume the LLM would be progressively worse. I genuinely don't see how that would be a reasonable assumption. >Will humans do worse in base-3 than base-9? Why not? If you haven't learnt base 3 but you have base 9 you'll do poorer on it. >That, IMO, is an indicator that something different is going on. Whether something different is going on is about as relevant as the question of whether submarines swim or plans fly or cars run. >I.e., humans are deriving principles to work from rather than just pattern recognition. Not really.…

Paper and discussion history. A mention is not an endorsement.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — mentioned by chaxor

Thu, 25 May 2023 01:05:15 GMT

Perhaps, but taken with other works in the area, a better picture does emerge regarding this claim. Substantial works already showing reasoning capabilities in GPT-4, which show that these models do reason very well - near human performance for many causal reasoning tasks. (1) Additionally, there is a mathematical proof that these systems align with dynamic programming, and therefore can perform algorithmic reasoning. (2,3) 1) https://arxiv.org/abs/2305.00050.pdf 2) https://arxiv.org/pdf/1905.13211.pdf 3) https://arxiv.org/pdf/2203.15544.pdf

Paper and discussion history. A mention is not an endorsement.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — mentioned by chaxor

Thu, 25 May 2023 01:01:18 GMT

There are substantial works already showing reasoning capabilities in GPT-4, which show that these models do reason extremely well - near human performance for many causal reasoning tasks. (1) Additionally, there is a mathematical proof that these systems align with dynamic programming, and therefore can do algorithmic reasoning. (2,3) 1) https://arxiv.org/abs/2305.00050.pdf 2) https://arxiv.org/pdf/1905.13211.pdf 3) https://arxiv.org/pdf/2203.15544.pdf

Paper and discussion history. A mention is not an endorsement.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — mentioned by famouswaffles

Mon, 22 May 2023 22:23:07 GMT

>It's not better at reasoning. It's barely even capable of it You are wrong. and there's many papers to show otherwise. Algorithmic, Casual, Inference, Analogical LLMs reason just fine https://arxiv.org/abs/2212.09196 https://arxiv.org/abs/2305.00050 https://arxiv.org/abs/2204.02329 https://arxiv.org/abs/2211.09066

Paper and discussion history. A mention is not an endorsement.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — mentioned by famouswaffles

Sun, 21 May 2023 02:46:45 GMT

No world model ? A world model is so obvious papers like these are more confirmation than surprise https://arxiv.org/abs/2305.11169 https://arxiv.org/abs/2210.13382 There a certain sentiment that AGI however you wish to define it won't infact be a "We'll know it when we see it" situation but rather a "AGI will arrive long before consensus reaches its AGI". LLMs have made me believe this will 100% be the case, either way. It's one thing to argue over things we can't evaluate even now but man the 100th "They can't reason!" every week is pretty funny when you can basically take your pick of…

Paper and discussion history. A mention is not an endorsement.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — mentioned by famouswaffles

Tue, 09 May 2023 01:03:35 GMT

LLMs are not very bad at reasoning. People say this but struggle to demonstrate how. There are many types of reasoning. For some like abstract analogical reasoning, LLMs are top % performers. https://arxiv.org/abs/2212.09196 There's many papers at this point demonstrating pretty strong reasoning. From Casual Reasoning, and explanatory reasoning to algorithmic reasoning. https://arxiv.org/abs/2305.00050 https://arxiv.org/abs/2204.02329 https://arxiv.org/abs/2211.09066 The only kind of reasoning that's somewhat lacking is logical reasoning. And even then it's not awful, just lagging behind…

Paper and discussion history. A mention is not an endorsement.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality — HN submission

Tue, 02 May 2023 14:39:26 GMT

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality

5 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.