NGM: A Plug-and-Play Training-Free Memory Module for LLMs — mentioned by pjankiewicz

Tue, 11 Aug 2026 20:54:13 GMT

That was my thinking as well mainly to increase the speed of training. But it may turn out that the simple statistics that you can capture like this may account for 1% of the training and are likely to be captured as the first thing during the training. But actually these techniques are used but they are hidden as speculative decoding with increasing complexity of approximations. For example you can have a part of the network that predicts the next word based on the markov chain, the next approximation is more complex etc. This paper proposes something similar where you can inject memory…

Paper and discussion history. A mention is not an endorsement.

NGM: A Plug-and-Play Training-Free Memory Module for LLMs · HackerPapers discussions

NGM: A Plug-and-Play Training-Free Memory Module for LLMs — mentioned by pjankiewicz