Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety · HackerPapers discussions

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety — mentioned by rarpa

Mon, 19 Oct 2026 09:41:02 GMT

> There is genuine research into latent space monitoring and interpretation That's great but the sentiment that CoT isn't useful for monitoring doesn't seem to be shared by mech interp researchers like Nanda. Also: https://arxiv.org/abs/2507.11473

Paper and discussion history. A mention is not an endorsement.

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety — mentioned by clbrmbr

Fri, 17 Apr 2026 00:31:56 GMT

There’s also a paper [0] from many well known researchers that serves as a kind of informal agreement not to make the CoT unmonitorable via RL or neuralese. I also don’t think Anthropic researchers would break this “contract”. [0] https://arxiv.org/abs/2507.11473

Paper and discussion history. A mention is not an endorsement.

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety — mentioned by Turn_Trout

Wed, 08 Apr 2026 15:31:52 GMT

I agree that they called many things remarkably well! That doesn't change the fact that AI 2027 is not a thing which happened, so it isn't valid to point out "this killed us in AI 2027." There are many reasons to want to preserve CoT monitorability. Instead of AI 2027, I'd point to https://arxiv.org/html/2507.11473.

Paper and discussion history. A mention is not an endorsement.

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety — mentioned by the8472

Sun, 04 Jan 2026 11:23:49 GMT

Yes. Coconut has the same issue. See also: a joint statement by researchers from several labs about CoT monitorability: https://arxiv.org/abs/2507.11473

Paper and discussion history. A mention is not an endorsement.

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety — HN submission

Wed, 16 Jul 2025 14:39:55 GMT

Chain of thought monitorability: A new and fragile opportunity for AI safety

Related: https://venturebeat.com/ai/openai-google-deepmind-and-anthro...

134 points; 64 discussion replies on HN. Paper and source history. A submission is not an endorsement.