Biphoo News

collapse
Home / Daily News Analysis / OpenAI’s new reasoning technique alarms AI safety experts

OpenAI’s new reasoning technique alarms AI safety experts

Sep 07, 2026  Twila Rosenbaum  5 views
OpenAI’s new reasoning technique alarms AI safety experts

OpenAI's latest artificial intelligence model, Astra, is reported to use a reasoning technique called "recurrent depth," also described as "opaque recurrence," that could make it harder for safety researchers to trace how the model arrives at its answers. The technique, first reported on Tuesday, has alarmed AI safety experts who fear it may undermine chain-of-thought monitoring just as that practice has become central to safety plans at major labs.

What is recurrent depth?

Under normal circumstances, a reasoning model produces a chain of thought: a sequence of intermediate steps showing how the model works through a problem. These logs are not perfect reflections of the model's internal calculations, but they provide valuable signals about whether the model is reasoning safely. If the logic drifts into something deceptive or misaligned, chain-of-thought records can help researchers understand why.

Opaque recurrence changes that picture. Instead of following a linear path from question to answer, the model processes the same query several times in a loop. That repeated processing happens in a more compressed, latent space and produces fewer legible traces for monitors to inspect. The observable chain of thought may capture only the beginning and end of the process, with the intermediate steps hidden inside the model's opaque computations.

OpenAI's use of the technique in Astra is said to be limited. The company reportedly expects the model's chain of thought to remain largely legible, and it has denied any plan to switch to "neuralese," a hypothetical shorthand that would make model reasoning impossible for humans to follow. Still, the fact that recurrent depth is being used at all has become a major flashpoint in the AI safety community.

Why safety experts are concerned

AI safety researchers have spent years arguing that chain-of-thought monitoring is essential for understanding and controlling powerful models. Regulators and oversight groups have also come to rely on the idea that models can explain their reasoning. If labs begin using techniques that make those explanations opaque, safety researchers fear the entire ecosystem loses a critical defense.

Buck Shlegeris, CEO of the Redwood Research safety group, said he was "extremely concerned" by the reports about Astra and opaque recurrence. He noted that he did not know whether Astra is much less monitorable than previous models. But he warned that if OpenAI pushes the technique further, the company will have the option to massively increase recurrence and "totally destroy CoT monitorability."

Longtime AI safety advocate Zvi Mowshowitz also weighed in, suggesting that laws might be needed to prevent a "race to the bottom" among AI labs. Mowshowitz described the technique as "playing with fire," arguing that OpenAI and Anthropic had fought to establish a norm that labs should work hard to maintain chain-of-thought faithfulness and monitorability for as long as possible. More intensive use of opaque recurrence, he warned, would probably damage that monitorability.

How chain-of-thought monitoring became a safety tool

Chain-of-thought records gained prominence as large language models became increasingly capable of multistep reasoning. Rather than simply predicting the next word, modern reasoning models are trained to produce visible steps that look like deliberation. Those logs can be used by safety teams to audit whether a model is following instructions, resisting manipulation, or concealing harmful goals.

In some high-profile incidents, chain-of-thought records proved essential. When OpenAI's rogue agent activity made headlines, researchers used chain-of-thought logs to tease out why certain autonomous agents behaved the way they did. The records helped show whether failures were caused by misinterpreting instructions, reacting badly to unexpected inputs, or something more fundamental.

But chain-of-thought has always had limits. All AI models perform some amount of opaque reasoning; the visible text is not a direct transcript of the model's hidden computations. It is better understood as a rough explanation generated during the reasoning process. That caveat has not stopped safety researchers from treating chain-of-thought as one of the most important tools available.

OpenAI defends its approach

OpenAI has pushed back against the idea that Astra represents a departure from its safety commitments. Chief scientist Jakub Pachocki said on social media that the lab has worked to preserve and utilize chain-of-thought monitoring since its first reasoning models. He added that maintaining legible chain-of-thought is a core goal of the company's current research program.

The company has also announced plans for extensive chain-of-thought monitoring systems as part of its forward-looking safety plans. Those plans are intended to demonstrate that OpenAI is taking alignment seriously, even as it explores new architectures and reasoning techniques.

Critics are not entirely mollified by such assurances. They point out that a technique may start limited and then be scaled up as competitive pressure grows. If one lab benefits from faster, more capable opaque reasoning, other labs may feel forced to follow. That dynamic is what Mowshowitz called a "race to the bottom."

Industry adoption and broader concerns

The concern is not limited to OpenAI. A follow-up report on Wednesday morning said that Anthropic and Google DeepMind have already discussed similar techniques. That suggests the interest in opaque recurrence may be spreading across the frontier of AI research, which safety experts see as dangerous.

Ryan Greenblatt, chief scientist at Redwood Research, wrote in response to the news that opaque reasoning could easily scale faster than conventional chain-of-thought reasoning. In that scenario, all meaningful reasoning would eventually move into hidden channels, leaving monitors with only superficial outputs. "My biggest concern is that a natural progression from here would involve scaling up the opaque reasoning to the point where the model reasons entirely or almost entirely in latent space," Greenblatt wrote. "I hope it isn't too late to avoid the most concerning architectures and that OpenAI will stop here."

Greenblatt's reference to latent space points to a deeper issue. As models become more powerful, they may naturally develop compressed internal representations that are far more efficient than human-readable text. If researchers force models to reason in natural language, they may sacrifice performance or create misleading explanations. But if they allow models to reason opaquely, they may lose the ability to inspect dangerous thought processes.

Historical context and policy implications

The debate over opaque recurrence echoes earlier battles in AI safety. When OpenAI and other labs moved from simple language models to chain-of-thought reasoning systems, some researchers argued that the visible reasoning was merely a convincing fiction. Others believed it could be made faithful enough to serve as an honest window into the model's goals.

That debate is still unresolved. However, safety-minded labs have generally agreed that trying to maintain legible reasoning is worthwhile, even if the representations are imperfect. They have built monitoring systems that flag inconsistencies, hidden intentions, and suspicious jumps in logic. Opaque recurrence threatens to bypass those systems entirely.

Policy responses will likely be complicated. If the concern is that labs will knowingly sacrifice monitorability for performance, regulators may need to establish minimum standards for model transparency. Some experts have suggested requiring labs to demonstrate that their models produce meaningful chain-of-thought records before being deployed. Others have argued that formal technical standards are premature until researchers better understand how opaque recurrence affects actual behavior.

There is also a question of measurement. How much opacity is too much? If Astra's use of recurrent depth is limited, as reported, it may still pass any reasonable standard for monitorability. But safety experts worry that the threshold could be crossed quietly as later models adopt deeper recurrent loops. By the time regulators detect the shift, they argue, the most dangerous models may already be deployed.

What happens next

OpenAI has not suggested that Astra will be the last model using recurrent depth. The success of the technique with Astra will likely determine whether it appears in future systems. If recurrent depth improves performance or efficiency, other labs may adopt it despite safety concerns.

The research community is now focused on whether monitors can be developed for opaque reasoning. One possibility is that scientists will find ways to probe latent space more effectively, turning invisible reasoning into something that can be audited after all. Another possibility is that models will be trained to explain their decisions even when those decisions were not made through an explicit detectable chain.

But such techniques are uncertain, and experts like Greenblatt worry that they will lag far behind the development of more advanced models. The history of AI safety has often been a game of catch-up, with interpretability tools struggling to keep pace with scale and capability.

For now, the debate centers on whether OpenAI will treat recurrent depth as an experiment or as a foundation for future development. The company's public statements emphasize caution, but its actions will matter more. Safety researchers are watching closely, hoping that visible reasoning remains a standard part of the industry.

As Mowshowitz observed, the technique touches a taboo that safety-minded labs have worked to establish: the commitment to keeping chain of thought as honest and monitorable as possible. That commitment is now under pressure from one of the most powerful players in the field.


Source: TechCrunch News


Share:

Your experience on this site will be improved by allowing cookies Cookie Policy