Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation — mentioned by internet_points

Wed, 11 Jun 2025 08:16:32 GMT

> I guess this means the reasoning traces are fully visible and not redacted in any way - interesting to see Mistral trying to turn that into a feature that's attractive to the business clients they are most interested in appealing to. but then someone found that, at least for distilled models, > correct traces do not necessarily imply that the model outputs the correct final solution. Similarly, we find a low correlation between correct final solutions and intermediate trace correctness https://arxiv.org/pdf/2505.13792 ie. the conclusion doesn't necessarily follow from the reasoning. So is…

Paper and discussion history. A mention is not an endorsement.

Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation · HackerPapers discussions

Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation — mentioned by internet_points