The Mosaic Memory of Large Language Models — mentioned by johndough

Tue, 21 Jul 2026 10:46:35 GMT

I am not arguing that Kimi did not distill Opus or Sonnet (which they almost certainly have, as opposed to Fable or Sol). I am arguing that even if they did not distill, the model could still identify itself as Opus or Sonnet. That being said, I'd like to point out a few things: - The second link (to claude-sonnet-4-2025051) had 17k matches, not just 3k. - grep.app does not index the entirety of GitHub, so the real number of occurrences of model identifiers is even higher. SourceGraph has a larger index, but the number is so high that it exceeds their result limit of 10k…

Paper and discussion history. A mention is not an endorsement.

The Mosaic Memory of Large Language Models · HackerPapers discussions

The Mosaic Memory of Large Language Models — mentioned by johndough