Microsoft releases humanist AI code of conduct with mandatory human oversight
In brief
- Microsoft released a 37-page code of conduct prioritizing human control and AI system oversight
- Code rejects AI consciousness and legal personhood, emphasizing human primacy over AI systems
- Framework addresses recursive self-improvement risks and EU AI Act regulatory compliance
- CEO Satya Nadella framed approach as 'Humanist Superintelligence' optimizing AI for human benefit
The Code's Core Principles
Microsoft's code of conduct targets the company's MAI model family, spanning reasoning, coding, image recognition, voice processing, and transcription. The document establishes three pillars: mandatory human oversight mechanisms, transparency requirements, and explicit prohibitions on harmful applications.
The code makes explicit claims about AI nature itself. It states that AI models are not conscious and should not be designed to imitate consciousness. Microsoft also rejects any pursuit of legal personhood for AI systems, drawing a sharp line between tool and agent.
Industry Context and Timing
Microsoft's move follows closely on industry pressure. Anthropic CEO Dario Amodei published an open letter on September 12-13 warning that recursive self-improvement and unpredictable AI behavior pose escalating risks. Amodei called for a coordinated slowdown across the industry. That letter drew public support from Sam Altman and Elon Musk.
The specific concern centers on verifying and controlling AI agents — systems that don't just generate text but take autonomous steps in the real world. Recursive self-improvement is the particular flashpoint. When an AI system can meaningfully improve its own capabilities without human intervention, the safety implications compound rapidly.
Humanist Superintelligence Framework
Microsoft CEO Satya Nadella has been framing the company's approach under the banner of "Humanist Superintelligence," a term first advocated by Microsoft AI lead Mustafa Suleyman in November 2025. The idea is that advanced AI systems should be optimized for human benefit rather than pursuing unchecked autonomy, with human objectives taking priority in design and deployment.
This framework sits within Microsoft's broader Responsible AI framework, which received an update on September 1 with the publication of the company's 2026 Responsible AI Transparency Report. The code also addresses regulatory compliance, particularly around the EU AI Act, which has been reshaping how major tech firms structure AI governance.
Market reaction was immediate. Nasdaq-100 futures declined as investors processed the implications of what a coordinated slowdown might mean for growth projections. The debate over AI safety versus innovation velocity continues to shape investment sentiment across the sector.
