The outbreak of the epidemic in 2020 directly promoted the rapid growth of online conference, education and other video products, and audio and video development was pushed to the peak of the storm. With the popularization and development of 4G and 5G technology, people are more willing to use faster and more convenient audio and video to transmit information. D sound, kuaishou and other short video platform fire, also proves that audio and video will be the future development trend!

What is WebRtc?

Learning audio and video development, you can’t jump off the protagonist we want to talk about today: WebRTC.

WebRTC(Web Real-Time Communication) is the GIPS engine of Global IP Solutions, a VoIP software developer, which Google acquired for 68.2 million DOLLARS in 2010. It was renamed “WebRTC” and opened in 2011 with the goal of building a platform for real-time audio, video and data communication between Internet browsers.

Well well… In short, it is the most popular audio and video call technology. We use wechat, QQ and other timely communication software every day are based on WebRTC development

WebRTC advantage

  • White prostitute (free)

WebRTC opens up human to human communication, free for developers, free for end users. It offers not just video chat, but other applications such as health services, low-latency file transfers, seed downloads and even gaming apps.

  • Save trouble (convenience)

WebRTC allows Web developers to add video chat or peer-to-peer data transfer to their Web applications without complex code or expensive configuration

It allows web applications or sites to establish PEER-to-peer (P2P) connections between browsers to transmit video and audio streams or any other data without using intermediary media.

  • Strong hole-making ability

WebRTC technology includes key NAT and firewall penetration technologies using STUN, ICE, TURN, RTP-over-TCP, and proxy support.

What is hole-making ability?

Take a common life scenario: how do we get over a mountain? Do we follow the mountain paths (possibly many) from the foot of one mountain to the foot of the other. Yes, this is the most common method, just ordinary network communication, find the way through the route. However, WebRTC is different, it will find a tunnel in the mountain, through the tunnel to achieve direct connection of two points, this is the ability to hole, is not very convenient.

The figure below is the overall WebRTC architecture diagram from the official website of WebRTC

  • Interpretation of the

The overall WebRTC architecture design can be roughly divided into the following three parts:

1. Purple provides apis for Web front-end development

2. The solid blue line provides apis used by major browser vendors

3. The blue dotted line contains three parts: audio engine, video engine and Network Transport. Can be customized implementation