Jalapeño’s first results show industry-leading speed and efficiency in AI inference

OpenAI's custom inference chip, Jalapeño, demonstrates industry-leading speed and efficiency in AI inference. Test results show that Jalapeño processes more AI work per unit of power and returns responses faster, achieving higher throughput and lower latency. This contrasts with existing hardware systems that typically require a trade-off between the two. Jalapeño improved AI work per watt by 1.5 to 1.9 times and reduced end-to-end latency by 1.7 to 3.6 times on models like GPT-OSS 120B, DeepSeek R1, and Kimi K2.5 1T, proving its broad architectural compatibility.

This is the first public disclosure of Jalapeño's performance metrics, showing it delivers 1.5 to 1.9 times more AI work per watt and 1.7 to 3.6 times lower latency than comparison systems.