How OpenAI Used Its Own LLMs to Design Its Jalapeño Chip

OpenAI has unveiled Jalapeño, its debut AI accelerator chip, which delivers up to 13.4 petaflops of 4-bit compute and accesses 232 gigabytes of memory at 15.4 terabytes per second. Benchmarks show Jalapeño can reduce end-to-end latency by up to 3.6 times compared to Nvidia’s GB300, while consuming less power. OpenAI is also integrating AI into the design workflow for its second-generation chip, including verification, physical design, and automatic waveform manipulation for debugging.

This report uniquely details how OpenAI used its own LLMs to design the Jalapeño chip, a first for the company in chip development.