The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding — mentioned by bgwalter

Sat, 20 Dec 2025 17:34:25 GMT

Regarding the stochastic parrots: It is easy to see that LLMs exclusively parrot by asking them about current political topics [1], because they cannot plagiarize settled history from Wikipedia and Britannica. But of course there also is the equivalence between LLMs and Markov chains. As far as I can see, it does not rely on absurd equivalences like encoding all possible output states in an infinite Markov chain: https://arxiv.org/abs/2410.02724 Then there is stochastic parrot research: https://arxiv.org/abs/2502.08946 "The stochastic parrot phenomenon is present in LLMs, as they fail on our…

Paper and discussion history. A mention is not an endorsement.

The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding · HackerPapers discussions

The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding — mentioned by bgwalter