Welcome to Tencent Cloud + community, get more Tencent mass technology practice dry goods oh ~
This article was published in the Cloud + Community column by Cloud Computing
QQ dazzle dance hand tour is Tencent game launched the sound of dance games. According to App Annie, QQ Cool Dance Mobile Game has remained the no. 1 music and dance game since its release, gaining popularity among gamers. One of the features of QQ Dadawu Mobile Game is the karaoke function in the game. Players can create karaoke rooms through the leisure hall and choose accompaniment for karaoke. The high sound quality, low latency and strong network resistance of the game multimedia engine GME provide good support for the music listening and k-song effect of QQ Dazzle Dance Mobile Game. GME allows real-time voice communication to flow while playing background music in the room; When a player is playing karaoke in the room in real time, the karaoke effect heard by the audience can also maintain very high sound quality and very low delay, providing a good online karaoke experience. So, what is the audio and video behind QQ Dazzle dance hand tour? Today’s article will demystify audio and video.
Tencent Audio and video Lab
Speaking of audio, we have to say Tencent Audio and Video Lab. Tencent Audio and Video Lab, founded in 2010, has been focusing on forward-looking research of audio and video communication technology for eight years. It includes global real-time audio and video network optimization, research on cutting-edge audio and video codec algorithms, computer vision image processing, AI-based audio and speech enhancement, sound beautification and audio and video quality evaluation, etc. At the same time, it has accumulated more than ten years of research experience in real-time audio and video communication, image processing, audio and video processing and other technical fields, and has industry-leading technical level. At present, it has provided audio and video technical support and services for hundreds of products in the industry, such as QQ phone, Tencent Cloud, enterprise wechat, QQ Space, National K Song, Kuaishou, Douyu, Huya, Mogujie and so on.
Game real-time voice solution GME
Game Multimedia Engine (SHORT for: GME) is a game multimedia engine SDK specially customized for game scenes, supporting a variety of game types such as casual social games, competitive games (including MMORPG, MOBA, FPS, etc.), large-scale national wars and so on, providing real-time multiplayer voice, real-time video, voice messages, voice to text and other functions.
Function is introduced
Real-time voice
M sequence pattern
Users take turns to voice on the mic, high sound quality and good fluency, suitable for voice werewolf killing scenes.
Free call mode
Support multiple people to speak at the same time, ultra-low delay, suitable for the multi-team open black and other competitive game scenes.
Command mode
It is suitable for large-scale national war games for one-to-many command operations and host voice play.
Voice messaging and speech recognition
Support recording voice messages sent to the game channels and real-time conversion into text messages this function, clear audio quality, high accuracy of speech recognition.
Product advantage
| Our advantages | Why choose Tencent cloud game multimedia engine |
|---|---|
| Game scene customization | For the game scene of audio and video codec depth optimization, make it in the bit rate, delay, system resource consumption and other key technical indicators to reach the industry leading |
| Top level infrastructure | Self-built 10 gigabit cloud machine room, equipped with 20-line BGP top-level network, 800+ nodes to allow players to enjoy a stable and fast experience |
| Professional Network Access | Reuse QQ access deployment and scheduling strategy, effectively solve the connectivity problem in weak network environment, connectivity rate as high as 99.995% |
| Super service bearing capacity | Bearing QQ service support capacity, support hundreds of millions of users online, hundreds of millions of groups; Real-time monitoring, remote disaster recovery, intelligent scheduling, ensure service security and reliability |
| Ultra-low access barrier | Universal game frame full coverage, four lines of code speed access |
| Complete and comprehensive functions | Provides common game functions, such as multiplayer voice, real-time video, voice message, and voice to text |
GME has very low barriers to access
In order to facilitate developers to access Tencent cloud game multimedia engine products, here is a guide for you to access the game multimedia engine SDK.
There are five steps to using GME:
- New GME service in Tencent cloud background;
- Download the corresponding client SDK.
- Refer to the access API document to transplant SDK to the project;
- Check daily operation background statistics;
- Independent elimination and feedback of special problems in the access process;
Access to the SDK
Access to the SDK requires the AppID and related permission key provided by Tencent Cloud. That is, the AppID in the application management list and the authentication information module in the application Settings.
- The permission key in the authentication information module is used for real-time voice access.
- The public and private keys downloaded from the authentication information module are used for offline voice access.
For details about platform configurations, see the engineering configuration documents of each platform.
GME application scenarios
e-sports
In esports, the battle situation can change rapidly, and players on the same side need to communicate their strategies in real time based on the battle situation. Tencent cloud realizes the real-time game voice free intercom with ultra-low latency and fluency priority, which can help players better communicate and experience the fun of battle games.
Frequents game
Frequents the typical representative in MMORPG game, this game involving a copy of the team, team, gangs, frequents command more style, taller also to voice delay constraint, tencent cloud multimedia game engine for such scenarios, realize the real-time automatic up-down wheat and ultra low delay voice calls, highly adapted frequents of massively multiplayer online game players voice requirements.
Casual games
In casual games such as chess, karaoke and music, voice messages and voice talk-back are also indispensable requirements. Meanwhile, in some casual games, there will be a beautiful hostess playing songs for players or playing karaoke games with song accompaniment. Tencent cloud provides real-time audio and video capabilities to ensure real-time chat and communication between friends, while providing interesting capabilities including ear echo and voice change to ensure the best casual game experience.
The werewolf killed
At present, the board game werewolf killing has been extended from the traditional dinner to the Internet. In the werewolf killing game, players make warm greetings before the beginning, speak in order during the process, and check and review after the end, all of these links are inseparable from real-time voice and video interaction. Tencent cloud game multimedia engine products provide real-time audio and video services with picture clarity and sound quality priority, specially customized for the werewolf killing scene, to meet all the audio and video interaction needs of players.
Voice-based in-game innovative entertainment
GME supports location-based 3D real-time speech
In 2017, a game, PUBG: Battleground, won the favor and popularity of global players in a short period of time through the innovative play of 100 people fleeing to kill and the winner eating chicken. In addition to the creativity of the gameplay itself, the game has also taken a radical approach to real-time voice gameplay. ** During the game, players can set [All mode] to shout, challenge and chat up nearby players. ** This voice mode can be very interesting to communicate and interact with strangers. There are already plenty of funny videos on social media based on the voice mode.
With the introduction of 3D positional voice, players will reveal their location and location during the shout, and their voice will change in real time based on their position. Arguably, 3D sound makes the player-to-player communication and combat experience in Battle Royale feel more real, more immersive, and more immersive.
Our 3D sound technology is to use “head associated transmission function” (HRTF algorithm) to model the time difference and spectrum difference between the ears, so as to form a sound with a sense of source location. At the same time, we also sampled reverb to fill in the ambient reflection sound missing from HRIR, so as to build a complete sound field model. In a small room, for example, you can not only hear the conversation between two people, but also hear the effect of the sound reflected off the wall, adding to the sense of immersion.
GME supports the in-game karaoke experience and provides fun voice change gameplay
The QQ Dazzle Dance mobile game is created by the original team of Mobile game, and the core experience of the product is consistent with the mobile game version. In addition, “QQ dazzle dance” mobile game also launched a pinball mode, the game real-time K song room and other original gameplay. However, the innovation also brings some difficulties in audio technology, such as the alignment of vocals, accompaniment and lyrics in karaoke, and how to make the sound clear and avoid echoes when multiple people speak at the same time in karaoke scenes.
Game voice is mostly used in real-time voice, multi-party conversation, voice message sending and other scenes, while the real-time karaoke gameplay of QQ Dazzle Dance is far beyond the normal range in terms of audio processing complexity. Under normal circumstances, in the process of karaoke, players sing after hearing the accompaniment, and the voice is collected by the microphone and then output. However, due to the delay of system acquisition and playback module in the game scene, especially due to the influence of various Android models and large acquisition and playback delay, there will be obvious misalignment of voice, accompaniment and lyrics if the combination is performed only in normal mode. When this happens, even the best singing sounds can turn into car crashes, making for a very bad experience.
These technical problems for the QQ dazzle dance mobile tour, is undoubtedly a heavyweight challenge. The Game Multimedia Engine (GME) provided by Tencent Audio-Video Lab, as a solution for in-game k-song play and real-time multiplayer voice, makes the mobile Game QQ Dazzling Dance show effects beyond expectations:
With good voice effects and low access barriers, GME provides real-time voice, voice messaging and voice-to-text functions, covering a wide range of game genres including casual social games, MOBAs and MMORPGs. Today, GME has accumulated profound technical knowledge through in-depth optimization of game types and game scenes. Meanwhile, GME has accumulated technical experience through technical support covering over 400+ game products, creating enjoyable game voice experience for players, demonstrating its leading technical strength in the industry.
Multimedia game engine GME products overview: https://cloud.tencent.com/document/product/607/10835
Multimedia game engine GME access guide: https://cloud.tencent.com/document/product/607/10782
Multimedia game engine GME SDK documentation: https://cloud.tencent.com/document/product/607/15232
Question and answer
Tencent cloud server?
reading
Game artificial Intelligence reading Notes (11) Game content generation
Game ai Reading Notes (8) Games and reinforcement learning
Game artificial Intelligence reading Notes (7) Games and supervised learning
Has been authorized by the author tencent cloud + community release, the original link: https://cloud.tencent.com/developer/article/1157948?fromSource=waitui
Welcome to Tencent Cloud + community or follow the wechat public account (QcloudCommunity), the first time to get more mass technology practice dry goods oh ~
Massive technical practice experience, all in the cloud plus community! https://cloud.tencent.com/developer?fromSource=waitui