How Minions.AI Cut Voice AI Phone Response Latency to Under 1.8 Seconds

Developer Parvej Shah published a technical breakdown of how the team behind Minions.AI, a voice dispatch platform for trade contractors, reduced AI phone response latency from roughly 2,900ms to under 1,800ms. The original pipeline processed audio sequentially — transcription, LLM generation, and speech synthesis each waiting on the previous step — making calls feel unresponsive and causing callers to hang up. The team replaced silence-based turn detection with a neural Voice Activity Detection model operating on 20ms audio frames, cutting end-of-turn detection from 800ms to 280ms. They also eliminated the wait for full LLM output by streaming tokens directly into the text-to-speech engine clause by clause, allowing audio playback to begin before the AI finished generating its response. Together, these architectural changes transformed the system from a sequential pipeline into an overlapping, event-driven stream that more closely mirrors natural human conversation timing.