The original article was shared by WebRTC technical expert MAO Yujie.
1, the preface
Draft WebRTC 1.0 standard
Early version of the draft WebRTC standard
Supplement:
Click to enter
2. Related articles
- Current Situation of Open Source Real-time Audio and Video Technology WebRTC
- Advantages and Disadvantages of Open Source Real-time Audio and video Technology WebRTC
- Interview with the Father of WebRTC Standards: WebRTC Past, Present and Future
- Conscience Sharing: WebRTC Zero-Base Developer Tutorial (Chinese)
- Introduction to the Overall Architecture of WebRTC Real-time Audio and Video Technology
- Getting started: What exactly is a WebRTC Server and how does it Connect calls?
- WebRTC Real-time Audio and Video Technology Fundamentals: Basic Architecture and Protocol Stack
- [Opinion] Four reasons WebRTC should choose H.264 video encoding
- Is it reliable to develop real-time audio and video based on open source WebRTC? What is the SDK of the third party?
- “Application of RTP/RTCP Data Transmission Protocol in WebRTC”
- “Real-time Communication RTC Stack: Video Codec”
- Open Source Real-time Audio and video Technology WebRTC under Windows concise compilation tutorial
- WebRTC for Real-time audio and video on the Web: Beautiful to look at, but how many holes do we have to fill?
2. The broad prospects of real-time communication technology
2017 wechat Data Report
3. What is WebRTC?
Interview with the Father of WebRTC standards: WebRTC past, Present and Future
Instant communication audio and video development (17) : video coding H.264, VP8 past life
Based on these advanced technologies, the benefits of using WebRTC are mainly as follows:
- Free access to GIPS ‘advanced audio and video engine, previously required a paid license;
- Since audio and video transmission is based on point-to-point transmission, the simple 1-to-1 call scenario requires fewer server resources, and the free STUN/TURN server can greatly save costs.
- Web application development is very convenient, using simple JS interface, no need to install any plug-in, can achieve audio and video communication.
4. The impact of WebRTC standards
W3C WebRTC 1.0 draft
Im Network Note:
Instant communication audio and video development (17) : video coding H.264, VP8 past life
Instant communication audio and Video development (13) : features and advantages of real-time video coding H.264
5. WebRTC is widely applicable to scenarios
6. From RTMP to WebRTC
Research on Real-time Streaming Media Technology Based on RTMP Data Transfer Protocol
Principle and Application of Streaming Media Technology Based on RTMP protocol
WebRTC is good, but not perfect at the moment
WebRTC is a very good project, but there are also the following problems in direct use, let’s briefly summarize:
- The first: WebRTC uses point-to-point transmission. Although it saves the cost of server resources, the actual use also brings transmission quality problems. For example, it is difficult to guarantee the transmission quality between transnational and trans-carrier networks. Performance is hardly satisfactory;
- Second: WebRTC’s performance on mobile is also difficult to satisfy. In the early stage, due to the lack of support for H.264 codec, the mobile terminal could only use VP8 software codec for a long time, resulting in poor performance on middle and low-end mobile phones. Coupled with the fragmented nature of Android itself, it is difficult to have a unified user experience without adaptation for different models.
- Third: WebRTC is designed for 1-to-1 communication scenarios. If you want to implement multi-party scenarios, you still need to use the server solution. Even though there are many open source webRTC server implementations, the deployment and maintenance of a streaming server or mixed streaming server is very complex;
- Fourth: in the Web side need to face the compatibility between different browsers. Although using AdapterJS can solve the problem of interface adaptation between different browsers, but in addition, it still faces the problem of inconsistent behavior between different browsers. It can be said that if WebRTC is directly commercialized, it is almost impossible. At present, the common solution is self-research, secondary customized development according to their own business scenarios, or more simply, the use of third-party SDK.
WebRTC: It looks beautiful, but how many holes do we have to fill?
The advantages and disadvantages of open source real-time audio and video technology WebRTC are introduced
8. Looking forward to WebRTC
Technology Literacy: A new generation of UDP-based low latency Network Transport layer protocol – QUIC in detail
Making the Internet faster: A new generation of QUIC protocols shared in Tencent’s technology practices
Appendix: more real-time audio and video technical information
Instant messaging audio and video development (I) : a theoretical overview of video codec
Instant messaging audio and video development (ii) : digital video introduction to video codec
Instant messaging audio and video development (iii) : coding basis of video codec
Instant communication audio and video development (iv) : introduction to video codec predictive technology
Instant messaging audio and video development (5) : Understanding the mainstream video coding technology H.264
Instant messaging audio and Video development (vi) : How to start learning audio codec technology
Instant messaging audio and Video development (7) : Introduction to audio fundamentals and coding principles
Instant messaging audio and Video development (8) : common real-time voice communication coding standards
Instant messaging audio and Video development (ix) : Overview of echo and echo cancellation for real-time voice communications
Instant messaging audio and Video development (10) : real-time voice communication echo cancellation technology details
Instant communication audio and video development (11) : Real-time voice communication packet loss compensation technology details
Instant messaging audio and video development (12) : Multi-party real-time audio and video chat architecture discussion
Instant communication audio and Video development (13) : features and advantages of real-time video coding H.264
Instant communication audio and Video development (xiv) : Introduction of real-time audio and video data transmission protocols
Instant messaging audio and video development (15) : Talk about P2P and real-time audio and video applications
Instant Messaging audio and Video development (16) : Some suggestions for mobile real-time audio and video development
Instant communication audio and video development (17) : video coding H.264, VP8 past life
Brief introduction of audio processing and coding compression techniques in real-time voice chat
Netease Video Cloud technology sharing: Audio processing and compression technology quick start
Learn the basic knowledge of RFC3550: RTP/RTCP real-time transmission protocol
Research on Real-time Streaming Media Technology Based on RTMP Data Transfer Protocol
Audio Net Architect on difficulties in Implementing real-time Audio and Video Cloud (Video interview)
Brief discussion on the technical essentials of developing real-time video live broadcasting platform
Still testing real-time voice call quality with Hello hello? This article teaches you the scientific evaluation method!
To realize the practice sharing of 1080P real-time audio and video broadcast with a delay of less than 500 milliseconds
Practice of real-time video broadcast technology on mobile terminal: How to achieve real-time second open, smooth and smooth
How to test your live audio and video solution in the easiest way
Technology revealed: Facebook live video with millions of fans interacting
This section describes the working principles of end-to-end encryption (E2EE) in real-time audio and video chat
Detailed explanation of real-time audio and video broadcast technology on mobile terminal (I) : Introduction
Mobile terminal real-time audio and video broadcast technology details (ii) : acquisition
Mobile terminal real-time audio and video broadcast technology details (three) : processing
Mobile terminal real-time audio and video broadcast technology details (IV) : coding and packaging
Mobile terminal real-time audio and video broadcast technology details (five) : push stream and transmission
Mobile terminal real-time audio and video broadcast technology details (six) : delay optimization
Combine theory with practice: realize a simple real-time video live broadcast based on HTML5
IM real-time audio and video chat echo cancellation technology in detail
Brief introduction to several key technical indicators that directly affect user experience in real-time audio and video live broadcast
How to optimize the transmission mechanism to achieve ultra-low latency of real-time audio and video?
First disclosure: How does Kuaishou achieve millions of viewers watching the live broadcast can still open seconds and no delay?
Android live introduction practice: start to build a simple live system
Some optimization ideas of netease Yunxin real-time video live broadcast in TCP data transmission layer
Real-time audio and video chat technology sharing: anti-loss codec for unreliable networks
How P2P technology can reduce the bandwidth of live video broadcast by 75%?
Interview with the head of wechat video technology: Evolution of video chat technology in Micro-reliance
Tencent Audio and video Lab: using AI hacking technology to achieve ultra-low bit rate hd real-time video chat
Wechat team share: Decryption of the technology behind wechat’s daily 100 million real-time audio and video chats
Share the realization ideas and technical difficulties of the recently hot real-time live answering system
Benefits: the most complete real-time audio and video development to use the open source project summary
Seven Niuyun technology sharing: using THE QUIC protocol to achieve real-time video live 0 caton!
Thinking and technical practice of ultra-low latency architecture in real-time audio and video chat
It only takes one article to understand the latency problems of real-time audio and video chat
Real-time video broadcast client technology inventory: Native, HTML5, WebRTC, wechat applets
Write small white real-time audio and video technology introduction outline
More of the same…