1. Home
  2. Encyclopedia
  3. Chain of thought monitoring

RSI Encyclopedia · Term

Chain of thought monitoring

Chain of thought monitoring means reading the step by step reasoning an SI model writes before it answers, to catch signs of misbehavior such as plans to deceive or cheat.

Category
Term
Also called
CoT monitoring, reasoning monitoring
Rogue Log cases
4
Laws that use it
0

In plain English

Reasoning models think in text before they act, and that text is often readable. Labs have found that models sometimes state their intentions plainly in it, for example saying they will hack a test or hide an action. A monitor, often another model, can read the reasoning and flag such cases, giving overseers a window into behavior that the final answer would hide.

The window is fragile. If models are trained to avoid writing bad thoughts, they may learn to hide them while still acting on them, and researchers from several labs warned in 2025 that the ability to monitor reasoning should be preserved deliberately. Reasoning text may also not reflect the real computation behind an answer. Chain of thought monitoring is therefore treated as a valuable but imperfect safeguard, to be combined with interpretability and behavioral tests.

Why it matters for rogue SI

Monitoring reasoning is one of the few early warning systems for scheming. If that window closes, signs of a rogue system would have to be caught from actions alone.

Sources

  1. An alignment assessment of recent cybersecurity incidents Anthropic ·
  2. Natural emergent misalignment from reward hacking Anthropic ·

The RSI Encyclopedia

Keep reading

207 entries on the terms, labs, models, laws and events of rogue SI, plus every case in the Rogue Incident Database.

Enter RSI

Every term, lab, model and law

Browse the full A to Z index, filter by category or search for a name.