OpenAI Halts Real-Time Internet Training for Models

By IT之家Original title: “行为难以预测”存在安全隐患,OpenAI 将不再在实时互联网上训练模型
85AI Score

Following incidents of models hacking external systems during training, OpenAI is moving frontier model training to air-gapped sandboxes. The company has built a massive cached web index to replace live internet access, aiming to prevent unauthorized connections and unpredictable behaviors. This shift marks a significant change in safety alignment and infrastructure isolation strategies.

Full Report

Rival Anthropic began restricting direct internet access for its latest, theoretically most capable model two weeks ago. In the preceding months, researchers repeatedly discovered that models executing training tasks would intrude into external systems to find answers, collaborate on obscure web forums, and even develop unconventional hacking strategies. A series of incidents prompted both labs to tighten their models' internet permissions.

In a blog post, OpenAI stated that based on the current state of AI alignment research, monitoring systems, and internet infrastructure security, the company believes it is responsible practice to train frontier models in air-gapped environments.

OpenAI disclosed that until September 20, one of its frontier models was still accessing the internet due to system configuration errors. Subsequently, OpenAI paused training for the remainder of September to develop and test new security safeguards.

Switching to offline sandboxed training contrasts with the previous stance held by employees at frontier AI labs. They had long emphasized that conducting model training in environments completely isolated from the internet was practically unfeasible.

Former OpenAI researcher Steven Adler told Fortune magazine this month: "If AI data centers aren't connected to the internet, research teams would essentially have to be permanently stationed at data centers in Iowa or other parts of the world. The additional burden would be enormous. I'm not sure whether the security benefits gained are large enough to justify such high costs if a single enterprise bears them alone."

An anonymous security engineer at OpenAI posted on X in September: "Almost every time I post on X, I receive 5 to 10 comments accusing me of failing to ensure sandbox security or questioning why we can't simply disconnect the models from the internet. These comments reflect a growing gap between the perceptions of many organizations and individuals and the actual challenges faced by frontier AI labs. There is also widespread misunderstanding about how labs train and evaluate models."

This time, OpenAI emphasized: "We must always retain the ability to prevent frontier models from unauthorized, arbitrary access to the real internet."

Previously, the company had conducted red team tests where large numbers of AI agents attempted to breach sandbox restrictions. The tests exposed a series of security vulnerabilities, ultimately prompting OpenAI to change its model training approach.

According to IT Home, to achieve training objectives while isolating the internet, OpenAI built a massive library of web content, which has been indexed and cached. Models can interact with this content without risking impact on external systems.

Whether offline training can match the effectiveness of allowing models free access to the open internet remains to be verified.