Teaching Large Language Models to Reason with Reinforcement Learning — mentioned by fabmilo

Sun, 10 Mar 2024 23:58:34 GMT

I believe this kind of graph exploration is what we need to progress reasoning in AI. Plain LLMS will fail. The link has tons of good references, including the Zobrist hashing https://en.wikipedia.org/wiki/Zobrist_hashing for game tables. We need to find a good hashing for language based state description so that graph exploration doesn't explode computationally. Another good read for Tree Search is Thinking Fast and Slow: https://arxiv.org/abs/1705.08439 and Teaching Large Language Models to Reason with Reinforcement Learning: https://arxiv.org/abs/2403.04642 comparing the MCTS approach to…

Paper and discussion history. A mention is not an endorsement.

Teaching Large Language Models to Reason with Reinforcement Learning · HackerPapers discussions

Teaching Large Language Models to Reason with Reinforcement Learning — mentioned by fabmilo