VoiceLoop: Open-Source Browser Voice Agent Library Rivals OpenAI Realtime on Latency
TodoForAI has open-sourced VoiceLoop, a zero-dependency JavaScript library that runs a full voice agent pipeline — VAD, speech-to-text, LLM, and text-to-speech — entirely in the browser. The library is designed for low latency, with first audio responses delivered in under a second by streaming TTS output while the LLM is still generating. A key feature is real barge-in detection based on transcribed words rather than microphone energy, which prevents the agent from cutting itself off due to speaker echo. Independent benchmarking via the team's own voice-agent-bench tool showed VoiceLoop with Deepgram and ElevenLabs matching OpenAI Realtime at roughly 862ms voice-to-voice latency while recording zero self-interruptions across 30 echo-coupled turns. The library is available on npm and supports any OpenAI-compatible LLM endpoint, with local WASM-based options requiring no API keys.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in