Under the background of space development of software and hardware technology, people’s imagination of Internet gameplay is gradually moving from creating virtual space to the integration of the real world and virtual space.
In October, Facebook founder Mark Zuckerberg changed the name of Facebook to Meta, making metasurverse a hot topic in the tech and investment circles.
When it comes to “yuan universe”, according to the current development pattern, it is a real space copy and reengineering process, namely the people on the Internet, reengineering a high immersive, experience and interactive virtual world, people can even based on various Internet companies to create the virtual world of reshape his life.
Of course, there is still a long way to go before such an ultimate goal can be achieved, but the COVID-19 pandemic has undoubtedly created more market demand for commercial use cases of the Metasomes.
For example, before the COVID-19 pandemic, most meetings were offline meetings. In offline meetings, participants could choose to have one-to-one, one-to-many or many-to-many real-time communication with others at any time. They could even book a “small conference room” to get to know their friends. Such a strong sense of scene experience is not available in traditional video conferencing.
At present, the mainstream traditional video conference is relatively simple in the presentation mode and lacks spatial scene, which makes the user layer lack the sense of the scene in the meeting process, and is prone to mental fatigue, concentration and other problems.
Focus on app experience to create a “New world” of Immersive meetings
To solve this problem, Netease Fuxi has launched an immersive meeting and event system, yaotai, to facilitate online meetings and events during the epidemic.
“Yaotai” itself creates a brand new ancient style immersive virtual conference world. In “Yaotai”, participants can set up a variety of activity venues in the scene according to their actual needs, and reproduce the real meeting scene with high precision.
At the same time, in order to enhance the interactivity and experience of the meeting, “Yaotai” not only synchronous implementation of PPT embedded playback, text and voice chat, simultaneous translation, multiple sub-venue free switch and other dozens of meeting functions, and to meet the social needs of the meeting, without adding a group, virtual people can meet to open a group chat.
(Virtual person approaches and starts “group chat mode”)
Considering that the virtual conference world is closer to the real conference scene, the conference organizer can freely choose the number, layout and content of exhibition boards in the activity venue from “Yaotai”; Number and layout of seats in the activity venue; Site loading advertising; Large screen, display board advertising; At the same time, “Yaotai” also supports the backstage independent management of meetings and conference data analysis and other functions
It is worth mentioning that in order to add authenticity and engagement to the user experience, attendees can create their own personal avatars by uploading personalized photos. Relying on the AI face pinching technology pioneered by Netease Fuxi, the platform will accurately restore portrait photos and facial features, analyze facial features through portrait network, reconstruct three-dimensional facial information, and combine the stylized network learning data to generate facial features of specific styles, such as hair style, skin color and facial features. At the same time, the facial expressions and movements of virtual people will change in real time with the change of real facial expressions and movements, so that all participants feel as if they are in the real meeting, and intuitively feel each other’s happiness and sorrow.
At present, yao Tai can be applied to international academic conference, signing ceremony, online exhibition, job fair, new product launch, brand promotion, company annual meeting, award ceremony, round table conference, campus information and many other scenes, and can accommodate up to 500 people at the same time in the main venue.
In addition, considering the frequency of participants’ participation in such activities and maximizing participants’ experience, Yaotai chose the simplest way, that is, to log in to the platform through a browser and enter the participant code to enter the meeting scene, eliminating a series of tedious processes such as downloading a client and registering an account.
Deeply cultivate the underlying technology to create “Yaotai” extreme interactive experience
As an expert in integrated communication cloud service built by netease with 24 years of IM and audio and video technologies, netease Yunxin provides core capabilities and components of integrated communication and audio and video. In the cooperation with Netease Fuxi, Yaotai has deeply integrated netease’s audio and video capabilities, screen sharing and other capabilities.
As an immersive conference system, “Yaotai” not only provides users with highly immersive and interactive conference experience, but also needs to improve the audio-visual quality of user experience and sharing quality of participants.
1. Self-developed AI algorithms to ensure users enjoy high-quality audio-visual experience
AI audio and video engine developed by netease Yunxin.com supports single and double sound channels, audio sampling rate of 16 khz-48 kHz, and the highest bit rate of 128 KBPS stereo hd sound quality; Supports 1080P hd picture quality for video calls. At the same time in order to avoid the call of the noise problem, netease cloud letter through the research of audio processing and 3 a algorithm AI audio noise reduction algorithm, and help users to speak to eliminate the echoes and the noise, and the unstable noise in noisy voices, keyboards and other directional noise reduction, to ensure “YaoTai” users to enjoy pure conversations and interactive experience.
In addition, netease Cloud audio and video technology allows users to join multiple rooms in yaotai at the same time to subscribe to audio and video streams in multiple meeting rooms at the same time, push local audio and video streams to a certain meeting room, and support close-range chat among 16 people in a meeting scene.
Considering the users to share and interaction of the network delay problems, netease cloud letter depends on the advanced precise bandwidth detection, intelligent congestion control, forward error correction, code optimization techniques, the measured resistance to packet loss rate of 80%, thus ensuring the YaoTai users even in complicated network environment can still enjoy the audio-visual experience high stability and low latency.
2. High availability network ensures global interaction of Yaotai
At present, the application scenarios of “Yaotai” have involved many international academic conferences, which requires to ensure the real-time transmission quality of various data under the condition of long distance and high complex network. We-can, the global intelligent routing network, the first transport layer base independent of business logic released by netease Yunit, perfectly supports media streaming, IM message, signaling and general data transmission, and provides stop-free video services for 99.9% of calls of “Yao Tai”.
At present, WE-CAN has realized node deployment in India, Middle East, Europe, North America, North Africa and other 200+ major regions in the world. Extensive node coverage, perfect operation mechanism, flexible scheduling strategy and intelligent routing strategy give WE-CAN the general attribute of “portal”, no matter where the user is, as long as the data enters the system, it CAN quickly reach the destination.
3. Real-time sharing, creating a simple and easy-to-use sharing environment
Netease cloud by letter “YaoTai” provides easy-to-use NERTC SDK, through a simple integration, a guest speaker at the meeting just need to their own screen contents such as documents, data, images such as web pages, PPT to share in the form of screen sharing to their audience, so that other participants discussed more intuitive understanding of the content and theme, Improve communication efficiency.
In addition, considering the problem of access cost, netease Cloud Communication helps “Yaotai” save access cost through Unity SDK packaging technology.
With the gradual popularization of virtual reality technology and audio and video calling technology, high-demand, multi-scene and low-threshold applications will accelerate the explosion of “Yao Tai”, and many gameplay innovations of “AI + conference” will also continue to evolve.
In the next step, Yaotai will further develop functions such as virtual community, virtual reception and VR virtual reality, while netease Yunit will continue to expand its service boundaries and provide stable, mobile and reliable integrated communication cloud services for the meeting meta-universe, game meta-universe, social meta-universe, education meta-universe and other scenes.
Recently, netease Yunxin jointly launched the industry’s first “avatar +RTC” integration SDK with netease Fuxi Laboratory, and formed netease Yunxin virtual image real-time interactive solution based on the integration SDK. The solution CAN not only vividly restore the virtual human image, but also combine with the Communications Acceleration Network (WE-CAN) real-time transmission capability of netease Cloud, which CAN realize the virtual human real-time interaction and help enterprise customers to realize the virtual image real-time interaction scene. Take the first steps into the metadverse.
Fill out the form for a free trial now >>>
Netease Yunxin virtual image real-time interactive solution has six advantages:
-
Image: highly restored, extremely clever.
-
Hardware: No wearable devices, mobile phones can be achieved.
-
Performance: end – cloud collaboration, 1000 yuan machine can also play.
-
Interaction: low latency and no lag, comparable to “face-to-face communication”.
-
Convenience: one SDK implements two core technologies.
-
Scenario: multi-industry application, cost reduction, efficiency improvement, and one step faster.
Fill out the form for a free trial now >>>