The AV Pipeline Kit added in HMS Core 6.0 is another technology opening of Huawei in the media field. By creating a flexible and customized audio and video scene framework, the service endouses the APP with rich audio and video processing capabilities, and simplifies the workload of business development such as audio and video collection, editing and playing, so as to facilitate the rapid development of applications in the fields of audio and video, social networking and e-commerce. https://www.bilibili.com/vide…
Multimedia Pipeline has three capabilities: custom pipelining, video hyperscore, and sound event detection. By automatically parsing plug-ins and selecting plug-ins, developers can integrate plug-ins into media applications, realize media application innovation in acquisition, editing and broadcasting, and improve user experience. On the basis of meeting the constraints of the multimedia pipeline, third-party plug-ins can be easily integrated by the multimedia pipeline to help developers efficiently focus on media innovation business.
Multimedia pipeline services provide developers with the ability to super-divide video, allowing users to enjoy a high-resolution experience while watching low-resolution video. This capability supports frame by frame superdividing during video playback, providing real-time noise reduction, color enhancement and other capabilities. It can enhance the picture quality of high-resolution video and superdividing the low-resolution video to improve the viewing experience. It supports 270P-720P and other resolutions, and can achieve up to 3 times superdividing. The video super score also has the characteristics of adaptive resolution and bit rate adjustment, which further improves the use experience.
Sound event detection is another capability of the multimedia pipeline service, which supports sound event detection of sounds in audio playback. The multimedia pipeline service provides sound event detection capability with faster identification speed and higher accuracy. At present, it supports 13 categories of sound event detection, such as knocking on the door and car chirping. Developers can use this ability to recognize things like baby cries, kitten meows, etc., to enhance the experience of home assisted reminders.
Multimedia pipeline service has three characteristics: ease of use, high performance and low power consumption. In terms of ease of use, the multimedia Pipeline service predefines the PIPELINES to support basic acquisition, editing and broadcasting functions, and also supports the rapid expansion of the PIPELINES, providing developers with rich auxiliary tools for development. In terms of high performance, multimedia pipeline services use unified data format encapsulation, support automatic reference technology, truly realize the data between modules “zero copy”; With the hardware capability detection technology, the node with hardware acceleration capability is preferred to be called, which improves the performance by over 10% compared to traditional Pipeline. In terms of low power consumption, the multi-modal media framework provided by the multimedia pipeline service reduces power consumption by reducing data copying and data format conversion, and prioritizes hardware capabilities, resulting in a power gain of more than 20%, helping applications achieve better performance and power balance.
Multimedia pipeline service can effectively solve the difficulties in audio and video application development, high power consumption pressure and pain points affecting user experience, so that developers can focus on innovation. With the opening of multimedia pipeline service capacity, there will be more high-quality applications to bring better experience to users.
HMS Core Black Technology, get to know it
Huawei’s open source repository for multimedia pipeline services is located at GitHub, Huawei’s official forum for HMS Core, and Huawei HMS Core is located on the Stack Overflow
Click the attention on the upper right corner of the image to get to know the latest HMS Core technology in the first time