WebRTC Live.

UP NEXT! WebRTC Live Episode 115

Using Voice AI and Avatars to Scale Live Training

How can you use AI to scale clinical roleplay training beyond what live sessions with human trainers can deliver? For CETA Global, a nonprofit that trains frontline mental health providers around the world, the answer was an AI “flight simulator”: a real-time platform where psychologists practice difficult client sessions with an AI-generated patient, complete with a lip-synced streaming avatar, live coaching, and replayable feedback. Behind the scenes, a team of six AI agents works in concert to play the patient, coach the trainee, and evaluate the session in real time.

In this episode of WebRTC Live, host Arin Sime sits down with Andrés Rincon, the WebRTC.ventures lead developer on the project, for an inside look at EBTSim, which went from concept to working platform in just eight weeks for a Google.org Accelerator: Generative AI demo.

They’ll dig into what it takes to make concurrent AI feel like a single conversation: a WebSocket-based real-time communication layer, purpose-built Gemini agents orchestrated through Google ADK, low-latency speech-to-text and text-to-speech, and HeyGen streaming avatars. Andrés will also share the design decisions that shaped the experience, including why the team chose push-to-talk over automatic turn detection, and how they made the AI client’s resistance adaptive rather than scripted.

If you’re building voice AI applications, multi-agent experiences, or training simulators, this episode is full of practical lessons on video avatars, agent orchestration, live coaching, and automated assessment that help professionals build and demonstrate competency in realistic scenarios.

Wednesday, July 22 at 12:30 pm Eastern (time may change)

Register for WebRTC Live 115