At Which Training Stage Does Code Data Help LLMs Reasoning? — mentioned by reasonableklout

Sat, 07 Nov 2026 01:05:46 GMT

This isn't really comforting to me for 2 reasons: 1. A key insight of foundation models is that capabilities are correlated. For example, training on code improved general reasoning capabilities: https://arxiv.org/abs/2309.16298 2. A profound capabilities explosion in easily measured domains will still feel very different to today. Like, the moment we come up with a systematic, objective way to verify a task, we become obsolete at it?

Paper and discussion history. A mention is not an endorsement.

At Which Training Stage Does Code Data Help LLMs Reasoning? · HackerPapers discussions

At Which Training Stage Does Code Data Help LLMs Reasoning? — mentioned by reasonableklout