Zoom supports automatic captioning

Zoom is facing stiff competition from RTC’s PaaS service, which it recently launched in a failed $14.7 billion acquisition of FIve9. Zoom is also iterating to improve the stickiness of its products. Recently, the ability to automatically generate subtitles is now available for all free Zoom conference accounts. Currently, it only supports English, and other languages will be supported later.

From now on we won’t be afraid of broken English in meetings with foreigners.

Automatically generated captions can be automatically provided with speaker captions during Zoom video conferences or webinars. To enable this feature, you need to visit the Zoom Web portal. Participants can still privately ask the meeting moderator to enable live transcription during the meeting using the meeting toolbar. Zoom also supports manual captioning and integration with third-party captioning services.

So, when will Tencent conference support this function?

Relevant link: www.cnbeta.com/articles/te…

SharePlay online

On October 26, Apple released the official version of iOS 15.1. This update fixes a bug in iOS 15.0 where you can’t unlock your iPhone with the Apple Watch, and also officially launches FaceTime SharePlay, And bring Apple ProRes video to iPhone 13 Pro models.

SharePlay allows users to watch videos, listen to music and share screens with each other during FaceTime calls.

Apple has taken advantage of its ecosystem to improve the stickiness of its products. Currently, it has seen some small games trying to use SharePlay, and I believe that more innovative sharePlay-based gameplay will emerge in the future.

Android doesn’t have a similar gameplay or ecosystem yet, so I don’t know if there will be an update. Third party companies can offer similar gameplay and cross-platform solutions, but SharePlay takes advantage of Apple’s unique permissions, and it may be difficult for third party implementations to achieve similar cross-platform experiences.

At present, we can see more and more products in the direction of experience sharing, for example, karaoke experience sharing: offline karaoke can be sung in duet with friends, and friends can be heard singing in time. With the support of ultra-low delay, online karaoke can be connected to mics, and chorus experience without perceptual delay can be achieved. Listening to music experience sharing: “Listening to music together” is a new entertainment mode in online listening to music, which makes listening to music and social interaction perfect. When two strangers are matched and “listen together,” real-time audio, video and other interactive gameplay can also be played. Sharing movie-watching experience: Discussing movies with other moviegoers can increase the enjoyment of watching movies. Driven by new technologies, more shared experience modes are gradually emerging in online movie-watching scenes.

At the same time, it is not difficult to imagine that in the future, more apps with similar experience sharing will join teams with some new creative functions for their apps through co-play sharing, and the future of this feature is also unlimited.

Related link 1:36kr.com/p/145208081…

Related link 2:36kr.com/p/145737416…

Safari updates cause a lot of bugs

In the iOS 15.0 Safari update, webrTC-related features have been added, such as Insertable Stream support for end-to-end encryption, screen sharing, HTTP3.0 support, and even faceTime interworking in the browser. However, there are also a lot of bugs, which have a big impact on WebRTC. In iOS15.1, when WebRTC is used to push stream, it will crash. In Safari of iOS 15.0, websocket will fail to be connected if compression is enabled on the server.

WebRTC is going to implement SVC

In fact, WebRTC has long supported SVC of VP9, but it can only be enabled through the command line, and can not be enabled by default. SVC later became an extended specification of the WebRTC 1.0 API and is now fully supported for SVC. SVC is very useful in video conferencing scenarios, but it also brings some problems. For example, when SVC is enabled on mobile, hardware coding may be abandoned, and a beautiful technology will always arrive with many regrets and trade-offs.

After consulting Intel hardware codec support experts for Chrome, we learned that the implementation of SVC is not so perfect:

“In fact, VP9 for AV1 will only support L1T2 and L1T3, ignoring this API. However, the hardware encoding of AV1 is only supported on Windows, and only L1T2 and L1T3 will be supported in the future. Unless you only use software code.”

Now let’s just wait for SVC, something is better than nothing.

Related links:

Groups.google.com/a/chromium….

Two years later Skype Web is now available in Firefox

In 2020, as the online video conferencing method of communication took off unexpectedly due to the COVID-19 pandemic, it’s not surprising that Microsoft jumped on the bandwagon. Skype, the originator of VOIP, has gone downhill after being acquired by Microsoft. Many people may have forgotten Skype. After Teams, Microsoft’s Office bundle quickly took over the corporate Office collaboration market, and just after Microsoft was expected to abandon Skype, Skype made its Web version available in Firefox.

Some time ago there was even talk that Microsoft would reposition Skype to focus on young people. The reason why Skype supports the Web side is like Apple finally made FaceTime support the Web side. Although the WebRTC experience on the Web is not as good as the native experience, one of the advantages of the Web is that you don’t need to download, and people tend to underestimate this advantage. My personal opinion is that when the functionality or experience on the Web side is 70% native, people will actively embrace the Web version.

Relevant link: www.cnbeta.com/articles/te…

The Edge browser will support GeForce Now

Support for WebRTC has been getting better since Microsoft switched Edge from its own EdgeHTML engine to Chromium, and recently GeForce Now has been added to the Edge browser, allowing XBox players to stream their PC games to console games. Looks like it’s a WEbrTC-based CLOUD game over LAN. Wonder how many milliseconds of end-to-end latency they can achieve with a WebrTC-based cloud game over LAN.

The Edge browser update in September also added support for another cloud service, Google Stadia, allowing users to play games on Google Stadia using the Edge browser on Xbox consoles.

Keep an eye on cloud gaming.

Relevant link: hot.cnbeta.com/articles/ga…

References

[1] www.cnbeta.com/articles/te… [2] hot.cnbeta.com/articles/ga… [3] 36 kr.com/p/145208081… [4] 36 kr.com/p/145737416… [5] groups.google.com/a/chromium…. [6] www.cnbeta.com/articles/te…

Welcome to click on a button to subscribe to “Yunjian Big Tycoon” column, access to more quality content. Watch the ups and downs of cloud technology and listen to the big shots for guidance.