LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench · HackerPapers discussions

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench — mentioned by YeGoblynQueenne

Wed, 01 Jan 2025 02:28:31 GMT

>> Large language models (LLMs) have demonstrated incredible reasoning abilities, penetrating an increasing number of domains in our lives. This is now established orthodoxy, a bit like astrology in ancient times but it is complete nonsense. Nope, LLMs have not demonstrated any credible, or incredible reasoning abilities. They have demonstrated an excellent ability for approximate retrieval of previously observed answers (with variations, which should not surprise anyone given that those are generative models) but they fail spectacularly when they have to "reason" in contexts where they…

Paper and discussion history. A mention is not an endorsement.

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench — mentioned by roboboffin

Fri, 04 Oct 2024 18:00:35 GMT

For example, papers like this call into question whether or not a LLM can plan: https://arxiv.org/html/2409.13373v1 This is a basic form of reasoning, to plan out the steps needed to execute something.

Paper and discussion history. A mention is not an endorsement.

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench — mentioned by mrbungie

Mon, 30 Sep 2024 21:06:24 GMT

Last time I checked, o1 did much better in PlanBench that models from other providers indicating better perf in that area [1][2]. Probably that lead will rapidly decay as other players implement similar approaches to "reasoning"/LRMs. [1] https://www.arxiv.org/abs/2409.13373 [2] https://x.com/omarsar0/status/1838353480672563581

Paper and discussion history. A mention is not an endorsement.

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench — HN submission

Mon, 23 Sep 2024 16:57:29 GMT

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of O1 on PlanBench

2 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.