How can AI scale clinical roleplay training beyond what live sessions with human trainers can deliver? For CETA Global, a nonprofit that trains frontline mental health providers around the world, the answer was an AI “flight simulator”: a real-time platform where psychologists practice difficult client sessions with an AI-generated patient, complete with a lip-synced streaming avatar, live coaching, and replayable feedback. Behind the scenes, a team of six AI agents works in concert to play the patient, coach the trainee, and evaluate the session against evidence-based criteria in real time.
Host Arin Sime sits down with Andrés Rincon, the WebRTC.ventures lead developer on the project, for a look at EBT-Sim, which went from concept to working platform in just eight weeks for a Google.org Accelerator: Generative AI demo.
They dig into what it takes to make concurrent AI feel like a single conversation: a WebSocket-based real-time communication layer, purpose-built Gemini agents orchestrated through Google ADK, low-latency speech-to-text and text-to-speech, and HeyGen streaming avatars. Andrés shares the design decisions that shaped the experience, including why the team chose push-to-talk over automatic turn detection, and how they made the AI client’s resistance adaptive rather than scripted.
If you’re building voice AI applications, multi-agent experiences, or training simulators, this episode is full of practical lessons.
WebRTC Live #115: Using Voice AI and Avatars to Scale Live Training
Episode highlights and key insights to follow.
Up Next! WebRTC Live #116
Building Robust Voice AI Pipelines for Every Use Case with Varun Singh
Wednesday, August 12, 12:30 pm Eastern
