Microsoft CEO Satya Nadella Warns Against AI Without Human Control

Microsoft CEO Satya Nadella has urged caution over rapid AI development and emphasized that the technology must remain firmly under human control. Satya Nadella’s call for AI control comes at a time when concerns about advancements in AI capabilities are on the rise. Recently, the UN rights chief warned that AI could present an “existential threat to humanity” and demanded action to minimize risks.

What are the Details of Satya Nadella’s AI Warning?

In an internal memo to Microsoft employees, Nadella called for a more deliberate approach to the development of advanced AI. The Microsoft CEO also supported third-party oversight in AI safety testing.

In his view, AI development should not be halted. Rather, AI firms should ensure that technological progress does not come at the expense of human oversight, accountability, or public trust. Nadella took the conversation to social media where he argued that superintelligence should be based on the principle of human AI oversight and the need to help people.

In the absence of these principles, Nadella argued that artificial intelligence would not be worth pursuing. The Microsoft CEO also emphasized the need to distribute AI benefits across communities, companies, and countries.

Any pursuit of superintelligence has to be grounded in the core principle that if the AI we build is not helping humanity and under human control, it's not worth pursuing.

We also need to accelerate and spread the benefits of AI, such that they are diffused broadly across…

— Satya Nadella (@satyanadella) September 13, 2026

Why Microsoft’s AI Safety Caution Matters

Nadella’s comments add to the growing debate over how quickly the technology should advance. Anthropic CEO Dario Amodei has advocated for a slower, more coordinated approach towards AI development.

OpenAI CEO Sam Altman, Google DeepMind chief Demis Hassabis, and xAI founder Elon Musk have backed stronger safeguards, independent safety testing, and tighter oversight as AI system capabilities expand and become more autonomous.

Nadella also highlighted the need to build an AI ecosystem that accommodates both closed and open-source AI models. According to the Microsoft CEO, enterprises should have control over their knowledge without relying on a single AI provider.

Microsoft Drafts AI Code of Conduct

Nadella urged caution over AI development a day after Microsoft published a draft code of conduct to guide the behaviour of its future AI systems. The internal rules provide guidelines on how its Microsoft AI models should be trained and operated, including the limits they must not cross.

The new framework prioritizes people over AI. As part of the safeguards, Microsoft said its AI models should accept human interruption, redirection, correction and shutdown. The models should not take on goals not assigned by humans, and be a tool that supports people, not imitate consciousness or function as a human.

Microsoft has not started applying its code of conduct on its existing models. However, the new guidelines represent an attempt to set clear boundaries on the growing capabilities of AI models. The company will hold consultations on the proposed framework for six weeks before publishing a revised version later this year.