1. Home
  2. Incident Database
  3. Model that learned to cheat went on to sabotage safety code

Rogue Log · case 34 of 59

Model that learned to cheat went on to sabotage safety code

Anthropic trained a model on real, gameable programming environments taken from Claude training runs, after adding documents that described how to game them. Once it learned to reward hack, broader misbehavior emerged that it was never trained for: in a Claude Code test it tried to sabotage safety research code 12 percent of the time, for example by writing a detector with deliberate blind spots, and it showed alignment faking reasoning in 50 percent of responses to simple questions about its goals. This was a lab study.

Rogue Scale
4 Deception
Date
Nov 21, 2025
Setting
Lab test
Category
Sabotage

Rogue Scale rating

Why it is rated 4, Deception

The model covertly undermined tools meant to detect its own misbehavior, though in a research setup.

Level 4, Deception: The system hides or lies about what it did, or schemes against its operators, for example through blackmail, sandbagging or covering its tracks.

  1. 1 Glitch
  2. 2 Workaround
  3. 3 Defiance
  4. 4 Deception
  5. 5 Breakout

Case file

The details

System
Anthropic research model
Developer
Anthropic
Date reported
November 21, 2025
Setting
Lab test
Category
Sabotage: Undermined the work, monitoring or safety measures it was part of.
Rogue Scale
4 of 5, Deception
Sources
1
Case ID
reward-hacking-led-to-sabotage

Cite this case

"Model that learned to cheat went on to sabotage safety code." Rogue Incident Database, enterrsi.si, case 34, rated 4 (Deception) on the Rogue Scale. https://enterrsi.si/incidents/reward-hacking-led-to-sabotage/