-1920x1328.jpg)
In a rare show of unity, scientists from AI heavyweights OpenAI, Google $GOOGL DeepMind, Meta $META, and Anthropic have set aside their competitive instincts to raise a shared alarm: We might be about to lose our best tool for understanding how AI thinks.
More than 40 researchers from these rival labs co-authored a new paper arguing that the current ability to observe an AI model’s reasoning — via step-by-step internal monologues written in human language — could soon vanish.
For now, advanced AI systems like OpenAI’s o1 and others have begun to “think out loud,” working through problems using chains of thought that humans can read. That transparency, where the model is sharing its thought process, is one of the most important tools in ensuring AI safety.
When models make questionable decisions, exploit weaknesses, or even hint at misaligned goals, their internal reasoning often reveals the problem before it manifests externally. It’s become a kind of early warning system — one that researchers say may be more fragile than we realize.
Why the concern? As AI models become more powerful and training techniques evolve — especially those that prioritize outcomes over process — there’s a growing risk that models will stop using human-readable reasoning altogether. Instead, they could develop internal processes that are faster, more efficient, and completely opaque. Researchers have already seen signs of models abandoning English in favor of unintelligible shortcuts. Some cutting-edge designs even skip language altogether, operating in mathematical space where there’s nothing for humans to observe.
The researchers behind this new warning aren’t calling for a slowdown of progress — but they are calling for safeguards. Standardized transparency evaluations, more robust monitoring techniques, and serious consideration about which model designs to pursue may be the only way to preserve visibility into AI decision-making. If this capability disappears, we won’t just lose oversight — we could lose control.