I've been working with Claude Code out loud for months. Real two-way voice turned out to be hard, so I open-sourced my setup

For a few months now I've been working with Claude Code out loud. I talk, it talks back, and honestly it's the most natural way I've ever worked with an agent.

Then I noticed nobody around me works like this. My colleagues dictate their prompts, then go straight back to reading everything Claude writes.

Building a voice mode for an agent sounds easy. Speech-to-text in, a voice model out, done in a weekend. That's what I thought too.

My first version was a mess. It kept hearing its own voice through the speakers and taking it as me talking. The interruption handling was either too sensitive or too slow. And once the agent started working, it stopped listening. To stop it or change direction, I had to go back to the keyboard, which defeated the whole point.

Each of those needed real engineering to fix: proper echo cancellation, telling an actual interruption apart from a nod, catching what I say while it's busy, and getting it to answer in a couple of spoken lines instead of reading whole paragraphs out to me.

Now I just stay in the doc or the code and talk it through, like with someone sitting next to me.

So I cleaned up my setup, packaged it and open-sourced it. It's called Larmor. It works with any agent that supports MCP (Claude Code, Codex, Gemini CLI and others) and runs entirely on local models on your Mac: Parakeet for speech-to-text, Chatterbox for the voice, and Apple's echo cancellation. For now it's built just for Apple Silicon. In Claude Code you start it with /larmor.

How Claude helped: I built it with Claude Code. Claude wrote most of the code with me: the MCP server with the speak and listen tools, the hook that hands Claude what you said mid-work at its next tool call, the Stop hook that keeps a voice turn from ending without listening, the installer, and the menu-bar app that runs the speech engine. Interruptions took the most iterations. It now pauses its voice the moment you start talking, and only stops for good once it's clearly real speech and not a "mm-hmm".

It's free and open source (MIT). First launch downloads about 3.7 GB of models.

If you code with an agent, give it one session. I'd love to hear how it feels to you, especially the interruptions and the latency.