Welcome to Tencent Cloud + community, get more Tencent mass technology practice dry goods oh ~

This article is published by Tencent Game Cloud in cloud + community column

Tencent’s popular mobile game QQ Daowu was launched on major App stores on March 14 and quickly topped the list of free games in the App Store. As the youth memory of a generation of players, as early as before the release of the game, the number of full-channel reservations for QQ Dadawu mobile game has exceeded 2000W, which is no less popular than Tencent’s two eating chicken mobile games.

Real-time voice room hd music playback, Tencent audio technology to solve the industry’s problems

The QQ Dazzle Dance mobile game is created by the original team of Mobile game, and the core experience of the product is consistent with the mobile game version. In addition, “QQ dazzle dance” mobile game also launched a pinball mode, real-time voice in the game music room and other original gameplay. However, the innovation also brought some audio technology challenges: for example, hd background music in the game room, how to ensure the high quality of the music when the real-time voice is enabled, and how to speak clearly and avoid echoes.

Game voice is mostly used in real-time voice, multi-party conversation, voice message sending and other scenes. However, the complexity of real-time voice play in the game music room of QQ Dadawu mobile game is far beyond the normal range in audio processing. Under normal circumstances, when the phone volume mode is enabled in the real-time voice room, the sound quality of the music played in the room will be significantly reduced due to the influence of the echo cancellation and noise reduction module of the mobile phone system. When using the media volume mode to play hd music in the real-time voice room, the player needs to make sure that the real-time voice is clear and avoids echoes.

These technical problems for the QQ dazzle dance mobile tour, is undoubtedly a heavyweight challenge. The Game Multimedia Engine (GME) provided by Tencent Audio-Video Lab, as a solution of real-time multi-party voice in the Game music room, makes the mobile Game QQ Dazzling Dance show better effects than expected:

https://v.qq.com/x/page/s0709emc7lh.html

Video content

As can be seen from the video, the player uses the media volume of the mobile phone (instead of the phone volume) to bypass the audio processing module of the mobile phone system when making real-time voice calls in the game music room to achieve the hd playback experience like QQ music. When the player speaks, the voices are “isolated” from each other, so that each source can be clearly seen, and there is no noise or echo when mixing sounds, greatly improving the real-time voice chat experience when playing music in the game room.

In response, technical experts from Tencent Audio and Video Lab explained, “This is thanks to GME’s powerful music player capability, which perfectly integrates background music and real-time voice. We fully consider the use of mobile media volume model hd music playback, real-time interactions with the people in the room when the echo, the influence of the noise, through the research of high quality echo cancellation and noise suppression processing technology, in the game room music of high quality broadcast at the same time, reduce the echo and noise affect communication.”

Based on its own high quality echo cancellation technology, GME ensures that players can hear everyone speaking in real-time multiplayer voice scenarios without having their voices cut out. Even more creatively, players can switch to a radio duking effect while other players are speaking, improving the sound experience for both the audience and the speaker.

In addition, GME also boasts some “invisible” capabilities, such as ultra-low latency (30ms) earshot; In addition, as the real-time voice scene in the game music room has higher requirements for network transmission, weak network and anti-jitter requirements, GME also well meets these requirements.

GME solves audio challenges and provides a one-stop game voice solution for games

GME products have mature audio processing experience, especially in basic performance, has provided audio technology support for more than 400 products, technology is far ahead of the industry. GME supports different scenarios such as voice black and casual games, providing different sound quality experience and different anti-network damage technology in different scenarios, striving to bring users the best game experience. The average MOS score of real-time voice was 4.38 (full score of 5), and the average delay was less than 200ms. Through advanced packet loss recovery technology, packet loss compensation algorithm and excellent network resistance, it can maintain smooth communication and good sound quality even when the packet loss exceeds 50% and the network jitter is 1000ms.

GME also optimizes traffic consumption and CPU usage, which are of great concern to game players. For example, in MOBA games, under the premise of normal voice communication and good performance, the traffic consumption per minute in mobile network mode is less than 500KB, and the CPU usage is less than 10% on average.

It is worth mentioning that the 3D real-time voice technology developed by GME uses HRTF algorithm to build a human ear acquisition sound model based on the time difference and spectrum difference between the ears, and processes the sound without a sense of location into a sound with a sense of location of the sound source, so as to simulate the feeling caused by the sound source at any position in the space to the human ear. This technology could be used in “chicken Eating” and board games to make the experience better by providing the ability to hear sounds and identify positions.

With good voice effects and low access barriers, GME provides real-time voice, voice messaging and voice-to-text functions, covering a wide range of game genres including casual social games, MOBAs and MMORPGs. Today, GME has accumulated profound technical knowledge through in-depth optimization of game types and game scenes. Meanwhile, GME has accumulated technical experience through technical support covering over 400+ game products, creating enjoyable game voice experience for players, demonstrating its leading technical strength in the industry.

Multimedia game engine GME has officially on tencent cloud, game makers developers to provide service to our customers, detailed information can browse cloud.tencent.com/product/tmg…

Question and answer

HTML 5 Audio Loop?

reading

【 video 】 Cloud API practice tutorial (PART 1)

IOS Push

We use several popular mobile games and apps to help you understand android P Beta 2 compatibility issues ahead of time

Has been authorized by the author tencent cloud + community release, the original link: https://cloud.tencent.com/developer/article/1155113?fromSource=waitui

Welcome to Tencent Cloud + community or follow the wechat public account (QcloudCommunity), the first time to get more mass technology practice dry goods oh ~

Massive technical practice experience, all in the cloud plus community! https://cloud.tencent.com/developer?fromSource=waitui