Transformers represent belief state geometry in their residual stream · HackerPapers discussions

Transformers represent belief state geometry in their residual stream — mentioned by hackinthebochs

Sat, 14 Jun 2025 02:54:37 GMT

LLMs are modelling the world, not just "predicting the next token". They are not akin to "stochastic parrots". Some examples here[1][2][3]. Anyone claiming otherwise at this point is not arguing in good faith. There are so many interesting things to say about LLMs, yet somehow the conversation about them is stuck in 2021. [1] https://arxiv.org/abs/2405.15943 [2] https://x.com/OwainEvans_UK/status/1894436637054214509 [3] https://www.anthropic.com/research/tracing-thoughts-language...

Paper and discussion history. A mention is not an endorsement.

Transformers represent belief state geometry in their residual stream — mentioned by hackinthebochs

Mon, 09 Jun 2025 14:19:05 GMT

>But LLMs are fundamentally, completely, incapable of X. It is not something that can be a result of their processes. This is the very point of contention. You don't get to just assume it. > it is because it is, at its root, a statistical engine generating plausible next tokens, with no semantic understanding of the underlying data. Another highly contentious point you are just outright assuming. LLMs are modelling the world, not just "predicting the next token". Some examples here[1][2][3]. Anyone claiming otherwise at this point is not arguing in good faith. It's interesting how the people…

Paper and discussion history. A mention is not an endorsement.

Transformers represent belief state geometry in their residual stream — mentioned by hackinthebochs

Mon, 26 May 2025 01:09:14 GMT

LLMs are modelling the world, not just "predicting the next token". They are certainly not akin to parrots. Some examples here[1][2][3]. Anyone claiming otherwise at this point is not arguing in good faith. [1] https://arxiv.org/abs/2405.15943 [2] https://x.com/OwainEvans_UK/status/1894436637054214509 [3] https://www.anthropic.com/research/tracing-thoughts-language...

Paper and discussion history. A mention is not an endorsement.