On the Planning Abilities of Large Language Models : A Critical Investigation · HackerPapers discussions

On the Planning Abilities of Large Language Models : A Critical Investigation — HN submission

Sun, 17 Mar 2024 18:45:17 GMT

The Planning Abilities of LLMs: A Critical Investigation (2023)

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

On the Planning Abilities of Large Language Models : A Critical Investigation — HN submission

Sat, 09 Dec 2023 21:57:24 GMT

On the Planning Abilities of Large Language Models: A Critical Investigation

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

On the Planning Abilities of Large Language Models : A Critical Investigation — mentioned by epups

Thu, 14 Sep 2023 09:29:56 GMT

The article itself is very assertive and makes a lot of generalizations, but if you look at the source of their claims [1] you see that in the first study they are using GPT-3.5 and achieve only a 5% score on a reasoning test that largely relies on spatial intuition - some boxes need to be stacked and unstacked sequentially in a convoluted task. Then, they get criticised so they come up with another paper in which they use GPT-4, which has an improved performance of 30% - a 6-fold increase, which the author describes as "modest". They then decide to change the test to a much harder and more…

Paper and discussion history. A mention is not an endorsement.

On the Planning Abilities of Large Language Models : A Critical Investigation — mentioned by Xeophon

Fri, 28 Jul 2023 15:10:19 GMT

Related work is the planning paper by Valmeekan et al [1]. The gist is that LLMs are incapable of planning, which is due to their autoregressive nature. METAs Head of AI Yann Lecun also talks about this topic in a talk [2]. As RT2 is based on a similar architecture, I think the results will be similar. [1] https://arxiv.org/abs/2305.15771 [2] https://youtu.be/x10964w00zk

Paper and discussion history. A mention is not an endorsement.

On the Planning Abilities of Large Language Models : A Critical Investigation — HN submission

Wed, 28 Jun 2023 21:57:00 GMT

On the Planning Abilities of Large Language Models – A Critical Investigation

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

On the Planning Abilities of Large Language Models : A Critical Investigation — HN submission

Sun, 28 May 2023 16:51:29 GMT

On the Planning Abilities of Large Language Models – A Critical Investigation

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.