AI-powered voice agents are transforming communications across industries like telecom, healthcare, and enterprise customer service. But delivering low-latency, natural-sounding AI responses in real time at low costs remains a major challenge. Leveraging the “lightweight AI” of Small Language Models (SLMs) and free open-source stacks can help overcome the latency and cost barriers of real-time voice AI.
At ClueCon 2025, taking place in Chicago from August 4–7, WebRTC.ventures CTO Alberto Gonzalez will give a talk entitled, “A Recipe for Real-Time Voice AI: WebRTC, SLMs, and Open Source Software,” sharing lessons learned from our team’s experience building AI analytics and voice agents.
Alberto’s session will offer practical insights and real-world examples to help you build faster, more reliable voice AI experience. It will also walk through a live demonstration of an AI-powered WebRTC Assistant. Topics will include:
Key Voice AI Concepts, Technology, and Use Cases
- Current State of Main Voice AI Industries
- Challenges in Real-Time Voice AI
- The Role of WebRTC in Real-Time Voice AI
- When WebRTC Does, and Doesn’t, Make Sense for Voice AI
Standard Voice AI Architectures
- Overview of Common Voice AI Architectures
- Utilizing Open Source Models for Voice AI Development
Optimizing Prompts for Real Time Voice AI
- Tackling Prompt Latency
Leveraging Small Language Models: Lightweight AI for Real-Time Voice Applications
- Using SLMs for Voice AI
- Real-time Voice Intelligence: Integrating SLMs with WebRTC
Benchmarking Real-Time Voice AI Performance: Latency, Accuracy, and User Experience
- Measuring AI Agent Performance
- Typical Voice AI Pipeline Latency
- Recommendations for Sub-Second Latency
ClueCon: 21 Years of Exploring the latest RTC advancements
ClueCon is the annual developer conference created by the team behind FreeSWITCH. Now in its 21st year, ClueCon brings together engineers and thought leaders to explore cutting-edge RTC technologies through technical talks, hands-on demos, and collaborative discussion. It’s a must-attend for developers working on the future of real-time voice AI.
Conference registration is open. Discounted pricing available through July 31!
