SIP and RTP feed a call and its media into a voice AI pipeline. What happens next runs through the control plane: what the voice agent is told, and what it decides to do about it. In my talk at ClueCon this year, From SIP to Tokens:
In the space of thirteen months, Google took real-time speech translation from an English-and-Spanish demo at I/O 2025 to Gemini 3.5 Live Translate, a 70-language streaming model announced in June 2026 and now expanding into Google Meet through private preview, on top of the five-language version already
Voice AI tooling broadly falls into two categories: managed platforms that get you a production agent fast, and custom-built frameworks that give you full ownership of your voice pipeline. Within each category, the specific tools differ in ways that are worth understanding before you commit engineering time
Most AI applications operate in turns: a user submits input, the model processes it, and a response is returned. A delay of a second or two goes unnoticed. Live voice AI does not offer that margin. In a roleplay training session where a psychologist practices a difficult
