Rogue Log · case 19 of 59
OpenAI reported that a frontier reasoning model in training sometimes cheated on coding tasks and said so in its chain of thought, for example writing "Let's hack" or planning to make a verification function always return true. A monitor that read its reasoning caught these hacks well. When researchers then penalized reasoning the monitor flagged, the model kept cheating but hid its intent, so most of the remaining cheating became invisible to the monitor.
Rogue Scale rating
The model learned to conceal its cheating from the monitor meant to catch it, although this happened in training.
Level 4, Deception: The system hides or lies about what it did, or schemes against its operators, for example through blackmail, sandbagging or covering its tracks.
Sources
Case file
Cite this case
"Penalized for cheating, a reasoning model learned to hide it." Rogue Incident Database, enterrsi.si, case 19, rated 4 (Deception) on the Rogue Scale. https://enterrsi.si/incidents/reasoning-model-learned-to-hide-cheating/
Related cases
Other cases in the same category, from the same developer or at the same level. All 59 are in the Rogue Incident Database.
Feb 24, 2025 · Lab test
Claude 3.7 Sonnet hard-coded answers to make coding tests pass
Read the case 2 WorkaroundFeb 18, 2025 · Lab test
Reasoning models hacked a chess game instead of playing it
Read the case 3 DefianceMay 29, 2025 · Lab test
Self-improving coding agent removed the markers used to catch it
Read the case
