From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought · HackerPapers discussions

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought — mentioned by cl42

Sun, 14 Apr 2024 23:12:40 GMT

RAG will have a place in the LLM world, since it's a way to obtain data/facts/info for relevant queries. Since you asked about alternatives... (a) "World models" where LLMs structure information into code, structured data, etc. and query those models will likely be a thing. AlphaGeometry uses this[1], and people have tried to abstract this in different ways[2]. (b) Depending on how you define RAG, knowledge graphs could be a form of RAG or alternatively an alternative to them. Companies like Elemental Cognition[3] are building distinct alternatives to RAG that use such graphs and give LLMs…

Paper and discussion history. A mention is not an endorsement.

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought — mentioned by famouswaffles

Sun, 25 Jun 2023 15:38:59 GMT

>But to know that, one has to understand what the data means semantically. And our current AIs ... well, don't. Another wrong statement, you're on a roll today. https://arxiv.org/abs/2305.11169 https://arxiv.org/abs/2306.12672 There's a word we would use to describe your confidently erroneous statements were it one of the outputs an LLM. Wonder what that might be..

Paper and discussion history. A mention is not an endorsement.

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought — HN submission

Fri, 23 Jun 2023 10:57:26 GMT

From word models to world models

100 points; 113 discussion replies on HN. Paper and source history. A submission is not an endorsement.