Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents

Magnitude, an open-source inference engine for agents, optimizes itself for specific hardware, allowing open models to run up to 2x faster than llama.cpp. It compiles and tunes its kernels on the user's device, supporting Apple Silicon, NVIDIA, AMD, or CPU-only setups. Magnitude connects with existing agents like Pi, OpenCode, Hermes, and Codex, and ensures that prompts, files, and models remain on the user's machine, requiring no internet connection once a model is downloaded.