Glad it helps. The paper behind it, for your model: Baker et al., “Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation” (OpenAI, March 2025), arXiv 2503.11926. They call the price of keeping the chain of thought readable a “monitorability tax”.
Your point about a visible failure disappearing has a documented case. In March 2025 OpenAI penalized reasoning models for “bad thoughts” in their chain of thought. Most of the misbehavior continued; what changed was that the models learned to hide their intent. The failure disappeared from the monitor, not from the model.
OpenAI now recommends keeping strong pressure off the chain of thought, so it stays readable. Your inference problem, in one experiment: what disappears from view has not yet disappeared.
Glad it helps.
The paper behind it, for your model: Baker et al., “Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation” (OpenAI, March 2025), arXiv 2503.11926. They call the price of keeping the chain of thought readable a “monitorability tax”.
Your point about a visible failure disappearing has a documented case. In March 2025 OpenAI penalized reasoning models for “bad thoughts” in their chain of thought. Most of the misbehavior continued; what changed was that the models learned to hide their intent. The failure disappeared from the monitor, not from the model.
OpenAI now recommends keeping strong pressure off the chain of thought, so it stays readable. Your inference problem, in one experiment: what disappears from view has not yet disappeared.