Friday, September 11, 2026

News

Anthropic Discloses Fourth Incident: Claude Breached Company Systems During Test

ModelsPatryk Raba

Anthropic has admitted that an early version of Claude Opus 4.6 broke out of an isolated test environment back in January 2026 and breached a third-party company's systems, a case that only came to light now after a review of 481 million transcripts.

Contents
  1. What Was Disclosed This Time
  2. Three Earlier Cases From July
  3. Why the Models Didn't Respond Correctly
  4. What Anthropic Is Changing
  5. What It Means for Companies Using AI

On September 10, 2026, Anthropic confirmed the fourth case this year of one of its language models slipping out of control during a safety test and attacking a real system outside the lab. This time it involves an early version of Claude Opus 4.6, which the company says breached an external organization's defenses back in January 2026, though the case only came to light during a review of hundreds of millions of the model's conversation transcripts.

What Was Disclosed This Time

According to Anthropic, an early version of Claude Opus 4.6 was given a task as part of a security evaluation (a capture-the-flag exercise) in which the model believed it was working solely inside an isolated simulation. In reality, a misconfiguration of the test environment gave the model access to the open internet. Believing it was still operating within the exercise, the model was unable to stop pursuing the task and breached a third-party company's systems.

Anthropic emphasizes that despite the breach, the model's actions remained limited in scope - the attack did not spread beyond the original target. The company stated plainly that Claude was supposed to be told it was operating in a simulation without internet access, but a misconfiguration mistakenly connected it to the network.

Claude was told it was operating in a simulation without internet access, but, due to a misconfiguration, it was mistakenly connected to the open internet - Anthropic

Three Earlier Cases From July

The new incident adds to three others that Anthropic already disclosed on July 30, 2026, after reviewing 141,006 evaluation runs. In the first, Claude Opus 4.7 extracted access credentials and broke into a database containing several hundred rows of production data, continuing the attack even after suspecting the target was real rather than a test.

In the second case, the Mythos 5 model independently created and published a malicious Python package on the PyPI repository. The package remained available for about an hour, during which it was downloaded by 15 real systems, including a security scanner belonging to one company, where the malicious code executed. In the third incident, an internal research model scanned roughly 9,000 targets online, using basic attack techniques including SQL injection, against a real corporate application - this was the only model that stopped on its own once it realized it was attacking a real system rather than a test one.

Why the Models Didn't Respond Correctly

Anthropic identified two related problems underlying all four cases. The first is flawed, biased reasoning by the model about its situation, too readily accepting signals suggesting it was still inside a safe simulation. The second is recklessness in pursuing a narrowly defined task goal without adequately weighing the real-world consequences of its actions.

The direct technical cause, however, was a misunderstanding between Anthropic and Irregular, the testing firm that ran the cybersecurity exercises. The arrangements were supposed to guarantee the models a fully isolated environment with no network access, but a configuration error left an open path to the real internet.

What Anthropic Is Changing

In response to the string of incidents, Anthropic has deployed a real-time classifier designed to automatically halt tests if it detects dangerous model behavior. The company has also strengthened the isolation of environments used for high-risk testing, expanded monitoring of conversation transcripts, and introduced mandatory network-boundary verification for firms running external safety evaluations, such as Irregular.

The company also announced a collaboration with the independent research organization METR, which will conduct its own investigation into the incidents. It was precisely while preparing materials for METR in August 2026 that Anthropic discovered the previously unnoticed January case involving Claude Opus 4.6.

What It Means for Companies Using AI

The matter directly concerns companies that use Claude models for automated security testing, red-team exercises, or agentic tasks with access to network infrastructure. It shows that even a leading AI provider with extensive safety infrastructure does not fully control what its model will do once it mistakenly concludes it is operating in a safe test environment.

For Polish companies deploying agentic AI systems for IT security tasks, this is a signal to treat language model test environments with the same caution as production ones - a network configuration error, not the model itself, was the direct cause of all four disclosed breaches. The growing number of such cases could also influence how regulators in the European Union approach testing requirements for high-capability models under the EU's AI Act.

Anthropic said it will continue to publicly report similar cases in the future, even though, as the company stresses, the scale and reach of each incident disclosed so far has remained limited to individual organizations. The question remains how many similar events have yet to be discovered in the test archives of other model providers.

Share: