Microsoft’s new AI chip makes it less reliant on Nvidia’s GPUs

Microsoft has unveiled its third-generation Maia in-house AI chip, the Maia 300, which is designed to be the primary AI inference system for its products and services. This new chip aims to improve the cost and efficiency of running AI workloads in the cloud and is better equipped to handle advanced reasoning models and agentic tasks. Microsoft expects the Maia 300 to deliver 40 percent more tokens per megawatt compared to leading GPU-based systems and up to 7x the rack-scale token throughput of Maia 200 in a full 96-accelerator configuration. The Maia 300 will begin rolling out to production in 2027.