From task structures to world models: What do LLMs know? — mentioned by seanhunter

Thu, 23 Nov 2023 08:16:17 GMT

Actual reasoning shows the understanding and use of a model of the key features of the underlying problem/domain. As a simple example that you can replicate using chatgpt, ask it to solve some simple maths problem. Very frequently you will get a solution that looks like reasoning but is not, and reveals that it does not have an actual model of the underlying maths but is in fact doing text prediction based on a history of maths. For example see here[1]. I ask it for some quadratics in x with some specification on the number of roots. It gives me what looks at first glance like a decent…

Paper and discussion history. A mention is not an endorsement.

From task structures to world models: What do LLMs know? · HackerPapers discussions

From task structures to world models: What do LLMs know? — mentioned by seanhunter