The direction of Web audio and video belongs to a subdivision of the field of Web. If the direction of Web is changed to the direction of Web multimedia, it is necessary to understand the relevant knowledge of audio and video (encapsulation format, codec, etc.). This article records some of the audio and video orientation and Web multimedia columns and article summaries. Continuously updated…

1 column

1.1 Aliyun video cloud

TIPS: If a column image dies, leave a comment and someone should take care of it immediately

Related articles:

  1. WebRTC SDP details and analysis

The analysis of SDP is clear and comprehensive. Recommended in combination with RFC 4566.

1.2 C/C++ programming for WebAssembly

WebAssembly has many applications in the field of Web multimedia, this is a systematic WebAssembly tutorial.

The section on C calling JS functions lacks a form that I find more convenient, so I wrote a supplementary article: WebAssembly: Calling JS functions in C code

1.3 LeiXiaoHua CSDN

In the past 9 years, he has published a number of international conference papers, participated in academic exchange activities in Hong Kong and other places, studied video and audio technology, won the CSDN Blog Star in 2014 and 2015, and was awarded the MVP of Microsoft Greater China in Microsoft headquarters in the United States in 2015. His technology blog has more than 4.5 million views, and his video and audio technology column is called the “excellent reference manual” for video and audio professionals. Thor goes well — CSDN commentary.

2 Independent articles

2.1 Front-end audio and video noun

Literacy stickers, recommended first consumption.

2.2 ArrayBuffer

ArrayBuffer is an interface to JS binary manipulation. It is a basic tool in the Web multimedia world, but it should be mastered if you want to write code next.

  • Ruan Yifeng ES5 introduction to ArrayBuffer
  • JavaScript Advanced Programming version 4 6.3 Stereotype arrays

2.3 How to realize the front-end recording function

Use getUserMedia to start the local microphone, get the audio arrayBuffer(Float32Array type), and add the WAV file header to generate the audio file.

2.4 You don’t know the Web Workers (on) [7.8 K words | multiple warning]

Web Worker also has many applications in the field of Web multimedia, especially in combination with WebAssembly. This explanation is very detailed and comprehensive.

2.5 series: Web video player implementation

A lot of preparatory knowledge is generally required.

  • Web side H.265 player development and decryption
  • H.265/HEVC Web broadcast player kernel development and decryption
  • “14000 words” how to play the front-end Video player | photos early warning

2.6 IVWEB plays with the WASM series -WEBGL YUV rendering image practices

What YUV is, how to use WebGL to render YUV data, there is code implementation.

3.0 repo

3.1 Digital_video_introduction (Digital Video introduction)

From 0 introduce video coding related knowledge, very NICE