微软 CEO Nadella 提出 AI 安全新范式：默认模型已被入侵并实施强制隔离审计

出处作者 / 发布主体：Terrence O’Brien原标题：Satya Nadella says we should assume all AI models are ‘compromised’

68AI 研判分

核心综述

微软 CEO Satya Nadella 在 X 平台发文，主张摒弃将 AI 视为“嵌套黑盒”的传统观念，转而建立透明、可观测且具备防篡改人类可读证据的系统。他提出极具前瞻性的安全假设：必须默认所有高级 AI 模型从启动之初即处于“被入侵”状态，并据此实施类似紧急制动器的强制隔离与持续监控机制。这一观点旨在通过零信任架构应对超级智能潜在风险，推动行业从被动响应转向主动防御。

报道全文原始报道全文

Part OfThe AI Superintelligence Slowdownsee all updatesTerrence O'Brien is the Verge’s weekend editor. He’s covered the tech industry for over 18 years and knows a thing or two about synths.

In a lengthy post on X, Microsoft’s CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a “set of nested black boxes” whose advice and actions we simply accept or reject. He calls for building a more transparent system where models can be contained, observed, and leaves behind “tamper-proof human readable evidence.”

Many of his recommendations align with what we’ve heard from others in the industry: timely incident disclosure, independent audits, verifiable data, and containment. It’s on that last point that he appears to go slightly farther than some others in the field, saying:

We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on.

Unfortunately, Nadella also refers to AI as “super intelligence” throughout the post.

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

Terrence O'Brien

More in: The AI Superintelligence Slowdown

Anthropic is cutting off its internal evaluations from the internetTerrence O'Brien2 PM UTCAnthropic published a report about investigating “unintended model actions” during “evaluations and internal use.”Jay Peters12 AM UTCAnthropic’s AI gave Philadelphia police a fake tip about an unsolved homicideEmma RothOct 9