By Hamza Faisal
Microsoft says its AI diagnostic system has beaten generalist doctors at diagnosing complex medical cases — and its AI chief is calling the result a step toward “medical superintelligence.”
The system, called MAI-DxO (Microsoft AI Diagnostic Orchestrator), correctly diagnosed 83% of complex cases drawn from the New England Journal of Medicine in a study published Thursday in Science. Primary care doctors and general internists, working individually with reference materials, got 36% right. Mustafa Suleyman, CEO of Microsoft AI, told The Verge that “the technology is finally here.”
How the AI doctors' panel works
MAI-DxO coordinates several AI agents that behave like a panel of doctors from different specialties. They question a patient, order tests, debate a diagnosis, and revise their assessment as new information arrives — the same sequence a real diagnostic team follows.
To measure it, Microsoft built a new benchmark called SDBench. Instead of a multiple-choice exam question, each case becomes a step-by-step encounter: the participant starts with a brief summary, asks questions, orders tests, and finally commits to a diagnosis that is checked against the published outcome. The main test used 304 NEJM case records; a second used 325 emergency department cases from Beth Israel Deaconess Medical Center in Boston.
The system is model-agnostic — Microsoft tested it on top of models from OpenAI, Google, Anthropic, Meta and DeepSeek — but its best scores came with OpenAI's GPT-5 and GPT-5.5.
The fine print
The study's own data suggests much of the improvement comes from the powerful models underneath, with Microsoft's orchestration adding gains on top. And there is a caveat in the comparison: cases this complex are normally handled by specialists or physician teams, who were not part of the test. In publishing the results, Microsoft joins Google and OpenAI in claiming its AI can match or outperform doctors.
Suleyman also claims a real-world edge in the emergency department: MAI-DxO is 1.7x more accurate than ED physicians even when they can look things up on the web, at lower cost and with fewer medical tests ordered to reach a diagnosis. Real-world validation is still ahead — Microsoft says it is now testing the system in hospitals and has teamed up with Mayo Clinic on a smarter healthcare model.
What 'medical superintelligence' means
Alongside the paper, Microsoft published a manifesto defining “medical superintelligence” as the capacity to surpass the strongest human-led health systems in medical reasoning and coordination across the full arc of care. The company says it wants to move beyond testing individual tasks — answering exam questions, generating diagnoses — toward integrating AI with clinicians and healthcare systems.
Microsoft already sells dictation and radiology tools to clinicians, and describes MAI-DxO as an expansion of that work. For now, the paper is a benchmark result, not a deployment. But with a peer-reviewed Science paper in hand, the race to put AI diagnosis into clinics just got louder.
By Hamza Faisal



