When you first see “Clubhouse”, do you see “Clickhouse”? Don’t get confused, it’s not your fault! When I doubted myself, product developers said, “I’m not alone.”

Although the two “look like”, but the product is not exactly the same, can only be said to be unrelated. Clickhouse is the hottest database technology out there. With its powerful data processing ability, in the open source community also get super attention! Today xiaobian to help you take stock of the next! Get a quick look at the technology behind Clubhouse and Clickhouse

What is the Clubhouse

Clubhouse is an audio social app that focuses on immediacy. Users can create rooms and choose to initiate or participate in a chat. The room can be public, social (followers only) or private (mutual followers only). By raising their hands, the audience can become guests, ask questions and speak, and their roles can be switched.

Why is Clubhouse so popular

There are three main reasons behind the overnight popularity of Clubhouse.

First: the function of the product is simple and practical, easy to operate, easy for users to control.

Second: invite and provide quality content. The first users were kols from various industries, which adopted an invitation-only system. Most of the topics discussed were high-quality topics such as Internet and investment, attracting more attention.

Third, the epidemic has suppressed people’s social appeals, which can be expressed through software demands. During the epidemic, users’ social activities at home decreased and their social demands were suppressed. Clubhouse, on the other hand, is a real-time chat mode based on stranger relationship, providing users with offline social experience and satisfying their social demands.

But it is Silicon Valley’s Iron Man who has become the most popular Clubhouse of recent days. On February 1, less than an hour after musk, the new richest man, opened his room, the number of visitors reached the software’s maximum of 5,000 people.

The core technology behind Clubhouse

It can be seen that such a popular audio social software needs to meet several basic conditions from the technical guarantee:

1. Ensure the stability of trans-regional (global) large-scale simultaneous online number (5000+);

2, real-time synchronization, to ensure smooth audio without lag;

3. More accurate content and user push

4. Security guarantee of AC audio content.

Among them, RTC real-time audio and video and CDN play a crucial role.

RTC technology

Real-time Communications (RTC) : real-time audio and video technology. Including audio and video collection, encoding and decoding, network transmission and other functions, emphasizing real-time communication, delay in milliseconds, widely used in a variety of audio and video live scenes.

With the interconnection of everything, real-time communication is no longer limited to people, but also exists between people and equipment. The integration of visual and audio communication with production systems improves existing production processes and creates new application scenarios. JRTC products have the characteristics of fusion + edge and provide users with PaaS cloud services for real-time video and audio communication. With the help of core technologies such as low-delay distribution and scheduling, weak network enhancement, 4G+WIFI dual-link transmission, heterogeneous system fusion, edge node management, etc., Real-time communication and live broadcasting, AI, monitoring, SIP interconnect, realize data exchange and resource sharing, and realize the integration of resources and technologies. It combines with edge resources to reduce user access delay, which not only supports the security and smoothness of real-time audio software like Clubhouse, but also applies to video application scenarios.

CDN technology

Content Delivery Network (CDN) Content Delivery Network. Send the content on the source site, such as the pictures, audio and video of the website/application, to the acceleration node near the user, so that the user can get the content nearby, reduce waiting, improve the response speed and success rate of access.

In order to achieve smooth communication among global users, there are higher requirements on the number and distribution of CDN nodes. Similarly, jingdong big peace-making jingdong 11.11 618 global love season is also facing this problem, in order to support the group’s core business, jingdong jingdong cloud worldwide thousands of CDN nodes, through cloud operation, cloud storage technology, will be faster and more reliably deliver massive amounts of content to end users, Internet help enterprises to reduce operating costs, website Improve users’ Internet application experience.

Of course, in addition to these two key technologies, AI and security technologies are also necessary to ensure the healthy and smooth operation of an app. Through the AI algorithm, it can accurately identify the illegal content related to pornography, politics and violence in the audio chat in the room, effectively avoiding risks. Secondly, it is also necessary to ensure the broadcast room security, DDoS attack protection, data leakage prevention, virus outbreak and 0day vulnerability protection, system intrusion and other aspects of comprehensive protection.

Last year because of the outbreak many important meetings are using online solutions, in 2020 trade will jingdong technology provides technical services, great sino-asean meeting, during the service trade will guarantee from global users communicate, negotiate, accumulative total support games a total of more than 260 live BBS, nearly thousand exhibitors live, live to watch the total number of hundreds of thousands of people. This is inseparable from JINGdong technology cloud and AI and other technical support.

From products to technology, I believe you will have a comprehensive understanding of Clubhouse. Clickhouse, Clubhouse’s “twin”, may not be familiar to product developers, but let’s take a look.

What is a Clickhouse

ClickHouse is an open source analytical database from Yandex, Russia, with exceptional performance, even in the billions to billions of lines of data, with the ability to return seconds. To give you a sense of how ClickHouse performed 839 times faster than MySQL, four databases MySQL, Greenplum, Vertica, and ClickHouse performed 100 million queries in the same environment. Why is ClickHouse so fast? What are the characteristics of technology? In what scenarios? Next, we will answer for you:

ClickHouse is designed for AN OLAP database and uses a column-based data storage engine to save IO and compress data. And the use of shard partition, speed up the parallelism of data query.

It is recommended for massive data storage, query statistics, user behavior analysis, real-time reports, business intelligence, and other real-time analysis scenarios.

This is especially true in scenarios where you don’t need to fetch all the complete data, or where you only need to fetch the general trend in the case of large data volumes.

ClickHouse matches a variety of analysis scenarios for specific business needs and uses a variety of table engines to speed up data processing by eliminating data preprocessing. It also supports percentage data sampling and statistical analysis.

Based on the powerful data processing capacity of Clickhouse technology, in 2020, JINGdong Cloud based on open source Clickhouse, to build an analytical database based on cloud K8s platform — JCHDB. Users can quickly create, customize specifications, and change specifications. It can realize multi-core and multi-node parallel large-scale query, and its query performance is 1-2 orders of magnitude faster than traditional open source database, which can fully meet the requirements of data analysis of large business systems. JCHDB has distinct characteristics in terms of high performance, high availability and scalability:

  • High-performance: Using the latest generation of cloud host, CPU can support up to 64 cores, a single Pod can be expanded to 512 GB memory.

  • High availability: with the help of K8s scheduling management platform, K8s will automatically remove the Pod when it is found to be unavailable. At the same time, the platform will create a Pod and attach the cloud disk bound to the deleted Pod to the new Pod based on the StatefulSet mechanism. This way, if an instance fails for some hardware reason, the instance can be replaced in minutes or seconds.

  • Scalability: Based on some basic components of cloud hosts and cloud hard disks, the system provides flexible expansion interfaces and can be directly expanded in situ. Hot capacity expansion is also supported. You can expand the number of cpus, memory capacity, and disk space in minutes or even seconds without affecting users.

In addition, JCHDB also provides a perfect monitoring system, which can help DBAs better observe the running status of the database, intuitively observe the pressure distribution of each Pod, convenient and flexible adjustment of data pressure, and avoid the data bottleneck of a Pod. You can flexibly define alarm information based on the monitoring objectives.

Clubhouse and Clickhouse are two different Clubhouse products, but in the future, as Clubhouse products become more and more functional, it will increase the number of users when doing user portraits and analyzing user behavior. Clickhouse’s real-time ranking of users and other real-time analysis scenarios must also be enabled. In addition to gaining high attention, the two also bring people more thinking in the exploration of application scenarios.

Hopefully, this article will give you a sense of the technology behind Clubhouse and Clickhouse technology, and you will be able to enjoy chatting with product leaders and technology leaders alike

Didn’t see enough? See the link here for more Clickhouse dry goods articles.

Recommended reading

  • Big data | ClickHouse practice in JD energy Management platform

  • How to use ClickHouse for temporal data management and mining?

  • 839 times faster than MySQL! Uncover the mystery of analytical database JCHDB

Welcome to [JINGdong Technology] to learn about the developer community

More wonderful technical practice and exclusive dry goods analysis

Welcome to “JINGdong Technology Developer” public account