made a drop in proxy that kills runaway agent loops before they drain your openai bill

A developer created AI Circuit Breaker, a reverse proxy designed to prevent runaway agent loops from incurring excessive OpenAI billing. This tool addresses the common issue of autonomous agents repeatedly sending the same prompt after a tool execution timeout. By hashing incoming prompts and detecting three consecutive identical queries, it terminates the stream locally, preventing charges for runaway tokens. It also offers hourly dollar caps and operates with under 35ms latency, never storing prompt text to disk. A free tier is available for up to $15 of monitored spend.

This tool offers a unique approach to managing OpenAI costs by killing runaway agent loops locally, unlike provider billing alerts that notify users hours later.