Article

Microsoft CEO Nadella: Treat AI as an internal risk control and be ready for an emergency stop at any time

Insight Beating AI Flash News: Microsoft CEO Satya Nadella published a long article advocating treating AI models as an enterprise internal security risk-management matter. Even without malicious intent, models may make mistakes or be exploited by attackers. Especially when they can read sensitive data or perform critical operations on behalf of users, enterprises cannot rely solely on security assurances from model providers.

He calls for separating models from the Harness(Agent execution framework). What data a model can read and which tools it can invoke must be controlled by external systems. Each critical operation should leave tamper-resistant records that are easy for humans to review. He also calls for transparency in model chain of thought (the displayed reasoning process), while acknowledging that this content may not necessarily be reliable.

The toughest requirement is to assume from deployment that a model may be compromised and to establish isolation measures. Authorized personnel must be able to pause or shut it down at any time while Agent performs tasks, effectively installing an “emergency brake.” Models cannot review their own behavior; enterprises must also continuously test for failures and attacks and disclose incidents promptly.

Microsoft announced this month that its MXC isolation tool is officially available on Windows. It uses external policies to restrict the files and networks Agent can access.

Original link https://m.theblockbeats.info/flash/371327