AI is now capable of developing its own inference hardware

An open-source AI accelerator has been developed by AI, demonstrating its capability in creating inference hardware. Performance metrics show various models like LFM2.5-230M, Qwen3-0.6B, and Gemma 4 E2B achieving different token per second rates and DRAM usage. For instance, LFM2.5-230M int8 reached 59.0 tok/s with 14.5 GB/s DRAM. The accelerator also features faster prefill, though it is still limited by the matrix unit's multiply rate.

This report details the first instance of an AI developing its own inference hardware, unlike previous AI applications that focused on software or design.