Nadella: "assume a model is compromised"

In a long essay posted on Saturday, Satya Nadella said companies deploying ai should "assume a model is compromised and contain it from the start."

What he asked for

• an emergency brake: someone authorised can always pause or stop a model mid-task
• no single model trusted with a critical decision
• a record of what agents do that a person can read and nobody can tamper with
• continuous testing, independent audits and incident disclosure

Why it matters

The headlines ran with "emergency brake". The sharper point is that companies shouldn't rely on assurances from the model makers. Microsoft is OpenAI's largest partner and also sells Anthropic's models, so its chief executive is telling customers not to take any vendor's word for it, including Microsoft's.