Vonage Releases OpenTok macOS SDK (beta)
WebRTC is a great technology for real-time communication of audio, video and data. However, it can be challenging to set up and use on all the platforms. MacOS support, for example, can be challenging due to the differences between devices and versions. Enter Vonage's new OpenTok macOS SDK, which allows you to build native OpenTok real-time video applications for Apple computers. In collaboration with the Vonage native client team, I've written a set of macOS
February 24, 2023
Jen Oppenheimer
Comments Off on Watch WebRTC Live #76: WebRTC Exposed! Vulnerabilities and Attacks
Watch WebRTC Live #76: WebRTC Exposed! Vulnerabilities and Attacks
On February 15, 2023, Arin welcomed Sandro Gauci to WebRTC Live to talk about the WebRTC attack surface. Sandro is the Chief Mischief Officer, Founder, and CEO at RTC security audit and penetration testing experts, Enable Security. To the real-time communications community, he is also known as the original developer of SIPVicious OSS, the open-source security suite for auditing SIP-based VoIP systems. WebRTC uses encryption in the video, audio and data channels, and so it has some aspects of secure
February 24, 2023
Fahad Mahmood
Comments Off on Enhancing Customer Service Experiences with Vonage and Symbl.ai
Enhancing Customer Service Experiences with Vonage and Symbl.ai
The combination of WebRTC and Artificial Intelligence (AI) is enhancing customer service activities in contact centers across a wide range of industries. Hello, everyone. This is Fahad from WebRTC.ventures and I am back again to share my exciting WebRTC adventures! This time, I took my Vonage ship to the Symbl.ai universe to explore conversational intelligence. I developed a Customer Representative Application to prove how real time conversational insights can improve customer experience for airlines. Let’s
Background Removal Using Insertable Streams
Background removal and the ability to set custom backgrounds has become a non-negotiable feature in video conferencing applications. A few of my WebRTC.ventures team members have shown how to use Machine Learning to remove backgrounds in video conferencing applications that use Daily, Agora, and Vonage CPaaS providers. These approaches work well, but rely on an extra <canvas> HTML element to perform video stream manipulation. This can lead to issues when not done properly. Today, I will
February 9, 2023
Juan de la Roca
Comments Off on Background Removal and Custom Image Replacement with Daily React Hooks and MediaPipe
Background Removal and Custom Image Replacement with Daily React Hooks and MediaPipe
We see more and more that participants in a video conference want to hide the view behind them. To make it fun, they can use a virtual background. Having this option in an application will improve the user experience, so let’s see how you can remove the background and replace it with a custom image using Daily React Hooks and MediaPipe libraries. About MediaPipe and Daily MediaPipe offers out of the box solutions to use
February 7, 2023
Nikhil Doosari
Comments Off on Building an Amazon Chime SDK Video Conference with Serverless Architecture
Building an Amazon Chime SDK Video Conference with Serverless Architecture
Among the advantages of using the Amazon Chime SDK with serverless architecture is the ability to scale up or down as needed. You only pay for the resources you use, so you can easily increase capacity during peak usage periods and then scale back down when usage decreases. This can save significant amounts of money, especially for businesses that experience fluctuations in usage. Creating a meeting with the Amazon Chime SDK with serverless architecture is
High Available WebRTC Media Servers on AWS
One of the best ways to manage WebRTC media servers for medium to large scale usage is by using cloud-based, on-demand scaling. Amazon Web Services (AWS) offers some of the best tools that can help you to scale your infrastructure demand. One of the distinguishing features of a cloud-based solution like AWS is that you pay only for the resources you use during your WebRTC sessions. So not only will you reduce costs, you will
WebRTC Trends for 2023: Has WebRTC Reached Enlightenment?
What is the state of WebRTC application development at the beginning of 2023? What are the trends we can expect in the coming years? Here at WebRTC.ventures, we worked with dozens of clients in 2022 and hundreds since we started building live video applications with WebRTC in 2015. In this post, I’ll provide a few insights based on what we are seeing in the marketplace from our unique position as a leading integrator and application
January 23, 2023
Jen Oppenheimer
Comments Off on Watch WebRTC Live #75: Trends in Conversational Chat
Watch WebRTC Live #75: Trends in Conversational Chat
On January 18, 2023, Arin welcomed Webio’s Co-Founder and Chief Strategy Officer Paul Sweeney and CTO Ben Waymark to WebRTC Live to discuss the current status of conversational chat and where it is headed in the future. Webio is a Conversational AI orchestration company. They use conversational AI, machine learning, and natural language processing to understand customer intent and blend chatbots and live agent conversation. Watch Episode #75! Webio was founded around the time of
The Future of WebRTC … According to ChatGPT
Like many people, I've been playing around with ChatGPT. I was planning to write a blog post on "WebRTC Trends for 2023". Although I had my thoughts on that matter ready to go (and will still post separately), I thought it would be interesting to see how many of those line up with an answer from ChatGPT. It was an interesting exercise, and I've pasted the full exchange below. For those using ChatGPT to generate
Connecting to a Janus Media Server Using Janode
Janode is a Node.js adapter for the open source Janus WebRTC server. It enables users to develop an intermediary API between a Janus server and the client, providing a way to manage connections from the backend rather than the front end. This reduces the security and performance issues that arise from running the operations on the client side and exposing the Janus server directly to the client. Let’s take a look at some of the
January 6, 2023
Hector Zelaya
Comments Off on Is a CPaaS the Right Choice for my WebRTC Application?
Is a CPaaS the Right Choice for my WebRTC Application?
In a previous post and video from our CEO, Arin Sime, he made a useful analysis about the different approaches that exist for building WebRTC applications: relying directly on the base APIs, leveraging a media server, or using a CPaaS. Today, it’s time to give the latter of these alternatives its own spin-off post and take a deeper look at what a CPaaS is and whether it is a good option for your WebRTC application. CPaaS:
WebRTC Has Matured
As 2022 wraps up and we look back on another year in WebRTC development, it is amazing to see what has changed. One of the biggest things our team at WebRTC.ventures has seen in the marketplace this year is a maturing of what people are looking for in a WebRTC application. The pandemic certainly accelerated this growth and will leave this industry forever changed. However, my goal for 2023 is to never mention the pandemic
Why is it (Still) Hard to Build with WebRTC?
WebRTC is an open framework for the web that enables Real-Time Communications (RTC) capabilities in apps and in the browser. In 2021, WebRTC was finally officially standardized. WebRTC is everywhere these days, and certainly proved itself incredibly useful during the pandemic. But still, it’s not easy to build with WebRTC. Let’s look at why. Two APIs to rule them all WebRTC is based on just two main APIs: the MediaStream API and the RTCPeerConnection API.
December 16, 2022
Jen Oppenheimer
Comments Off on Watch WebRTC Live #74: Architecting Low Latency WebRTC Applications
Watch WebRTC Live #74: Architecting Low Latency WebRTC Applications
On December 14, 2022, Arin welcomed WebRTC.ventures CTO Alberto Gonzalez for our last episode of the year, "Architecting Low Latency WebRTC Applications." In theory, to make a WebRTC connection we simply need to capture/handle and send/receive media. In reality, WebRTC implementations aren’t that simple, especially for use cases like live broadcasting, professional events, telepresence, gaming, auctions, and IoT endpoints that require sub-second latency for thousands of users. Alberto discussed the challenges inherent in architecting low latency
December 1, 2022
Jen Oppenheimer
Comments Off on Hamza blogs on Vonage about Attention Detection with the Vonage Video API
Hamza blogs on Vonage about Attention Detection with the Vonage Video API
Hamza Nasir is a WebRTC Developer on the WebRTC.ventures team currently working with Vonage on their Video API platform. In collaboration with Vonage team member, Talha Ahsan, Hamza has written an Attention Detection web application tutorial showing how to integrate the Vonage Video API with TensorFlow's MediaPipe face detection model. Using attention detection technology can have a big impact on video conferencing in the education field, online meetings, and many more use cases. It allows presenters
Networking Basics for WebRTC: Networking in Action
In the previous posts in this series, I explained the basic networking concepts used in WebRTC. I introduced you to protocols and ports, the different types of networks, and the ways data can be transported. I also provided a high-level overview on signaling and ICE candidates exchange and also media transmission. If you haven’t read these, it’s recommended that you do so as in this post we will use the concepts explained there. While we
November 29, 2022
Jen Oppenheimer
Comments Off on First Steps Made in Official Partnership with Technological University of Panama
First Steps Made in Official Partnership with Technological University of Panama
Earlier this month, our Panama Operations Manager Rafael Amberths met with the administration of the Technological University of Panama (UTP). This meeting was the initial "formal" step in establishing an official partnership between our live video application development agency and the second largest university in Panama. The joint partnership goals include, but are not limited to: Encouraging and promoting the growth of professional knowledge in emerging technologies Creating competitive employment opportunities, through job openings, conducted as a result of
November 23, 2022
Jen Oppenheimer
Comments Off on Watch WebRTC Live #73: The Future of Broadcasting with WebRTC
Watch WebRTC Live #73: The Future of Broadcasting with WebRTC
On November 16, 2022, Arin welcomed Dan Jenkins to WebRTC Live to talk about the increasing role of WebRTC in broadcasting. Dan is the founder of Broadcaster.vc, a “broadcast from anywhere” service which helps companies to bring in video streams via WebRTC connections and inject them into traditional broadcasting tools and workflows via NDI streams. He is also the founder of communications app consultancy Nimble Ape, director of CommCon, and a well-known leader in the
Active Speaker Detection with the Amazon Chime SDK
In previous posts, we showed you how to build a two-party video chat and how to build a multi-party video conference, both using the Amazon Chime SDK. Capitalizing on the considerable flexibility that the Amazon Chime SDK offers for customizing the UI, we’re going to take yet another step in our application and add a new feature: active speaker detection to create a pinned video feed. This ability to implement any sort of visual design