For domestic open source database, now is the best era, but also the most challenging era.

The most popular track of basic software in recent years, database is undoubtedly one of the more popular field. According to 36kr statistics, more than 37 domestic database companies have obtained financing in the past two years, and as many as 20 enterprises will get a new round of financing in 2021.

Among them, the investors behind the enterprise are luxurious, including sequoia China, Hillhouse Capital, Jingwei Venture Capital, Yunqi Capital and other well-known investment institutions. At the same time, Tencent, Ali and other Internet giants have also entered the board, which is very lively.

However, at the beginning of the 21st century, the development of domestic database industry is still relatively slow, and it is even considered as a saline-alkali land. The only nutrients on this land are all absorbed by overseas database manufacturers that developed as early as 1970, and it is difficult for local companies to breed dazzling new stars. However, with the cultivation of capital and market fertile soil, an emerging industry rose rapidly in this era, gradually occupied the local market and began to go overseas.

01 Domestic open source database is climbing mountains and ushering in spring

Before 2014, among many domestic databases, Oracle (Oracle) was the first big one, followed by IBM and Microsoft. These three mountains have been lingering in the development of domestic database.

However, with the emergence of a paper “ban”, the vast majority of domestic science and technology enterprises are following the footsteps of domestic substitution, and gradually show a domestic database iteration tide.

At the same time, with the rapid development and business diversification of The Internet in China, a massive amount of data has soared. The traditional database can no longer meet the current demand for high concurrency, and the high IT operation and maintenance expenses brought by overseas leading database manufacturers are also eye-popping.

In this context, developers in the local market see an opportunity: China urgently needs to produce new databases developed by itself, break through the “bottleneck” technology, occupy the database market, and eat the cake of database ecology.

As a result, under the favorable policy, the pull of demand and the union of supply chain manufacturers, China’s database market ushered in the spring of flowers blooming. In 2017, from Gartner’s database series reports, we saw the presence of domestic databases for the first time. In addition, according to iResearch statistics, in 2020, the total size of China’s database market reached 24.71 billion yuan, with a year-on-year growth of 16.2%. Among them, from 2020 to 2022, China’s database market is expected to show a high growth trend.

When a hundred schools of thought contend, pain point and difficulty also follow. In this era of rapid rise of domestic substitution, the standards and norms of general database are in the hands of overseas giants, and most domestic databases are mainly closed sources, so it is difficult to unify the database ecology in the industry.

So, what is the way to build home-made and self-developed database ecology and accelerate the iteration of database technology?

Consider one set of numbers: as of January 2021, global deployment of open source databases surpassed commercial ones for the first time. It can be seen that the majority of the world’s mainstream databases are open source. So, if we want to build a domestic and self-developed database ecology, accelerate technological iteration and make domestic database go international, open source seems to be a good way to try.

And in March last year, open source was officially included in the “14th Five-year plan” development outline, which shows that open source will become an important support force for digital innovation technology and digital economy in the future, and domestic open source database will usher in a new spring.

02 “East and West”, these domestic open source databases are fighting in the cloud era

A number of government departments have jointly issued the Implementation Plan for Computing Power Hubs of the National Integrated Big Data Center Collaborative Innovation System, agreeing to launch the construction of national computing power hubs in eight regions, including the Beijing-Tianjin-Hebei region, the Yangtze River Delta, the Guangdong-Hong Kong-Macao Greater Bay Area and Chengdu-Chongqing, and planning 10 national data center clusters.

At this point, the overall layout design of the national integrated big data center system has been completed, and China’s huge project of “east and West calculation” has been fully launched.

In the digital economy increasingly important at present, domestic open source database to another spring today, these battles in the cloud native era of domestic open source database with what attitude to build a new ecological environment? It all starts with the project itself. Let’s take a look at these popular high-quality domestic open source databases.

TiDB

Open Source license: Apache-2.0

Author: PingCAP

Project Address:Gitee.com/pingcap/tid…

Project Introduction:

TiDB is a new generation database independently designed and developed by PingCAP. It has been open source since 2015. It is a Hybrid Transactional and Analytical Processing (HTAP) integrated distributed database product.

Architecture Display:

OceanBase

Open Source license: Mulanpub-2.0

Project author: OceanBase

Project Address:Gitee.com/oceanbase/o…

Project Introduction:

OceanBase is a financial grade native distributed relational database, which was created in 2010 and officially opened in June 2021. It has the characteristics of strong data consistency, high availability, high performance, online expansion, high compatibility with SQL standards and mainstream relational databases, and low cost.

Architecture Display:

PolarDB

Open Source license: Apache-2.0

Project author: Alibaba

Project Address:Gitee.com/mirrors_ali…

Project Introduction:

PolarDB is a cloud native relational open source database developed by Ali Cloud, which adopts distributed shared storage (storage and computing separation) architecture.

Architecture Display:

OpenMLDB

Open Source license: Apache-2.0

Project author: The Fourth paradigm

Project Address:Gitee.com/paradigm4/O…

Project Introduction:

OpenMLDB is an open source machine learning database that provides a full-stack FeatureOps solution for production-level data and feature development.

Architecture Display:

openGauss-server

Open Source license: Mulanpsl-2.0

Project author: openGauss

Project Address:Gitee.com/opengauss/o…

Project Introduction:

OpenGauss is an open source relational database management system, it has multi-core high performance, full link security, intelligent operation and maintenance and other enterprise characteristics.

Architecture Display:

TDengine

Open Source license: AGPL-3.0

Project author: TDengine

Project Address:Gitee.com/taosdata/TD…

Project Introduction:

TDengine is a high-performance, distributed, SQL-supporting timing database designed and optimized by TaOS data for Internet of Things, Internet of vehicles, industrial Internet, IT operation and maintenance, etc. Its core code includes clustering functions and all open source.

Experience code:

In TDengine terminal, users can use SQL commands to create/delete databases, tables, and insert queries.

create database demo; use demo; create table t (ts timestamp, speed int); insert into t values ('2019-07-15 00:00:00', 10); insert into t values ('2019-07-15 01:00:00', 20); select * from t; Ts | speed | = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = 19-07-15 00:00:00. 000 | | 19-07-15 01:00:00 10. 000 20 | | Query OK, 2 row(s) in set (0.00170s)Copy the code

Nebula

Open Source license: Apache-2.0

Project author: Vesoft – Inc

Project Address:Gitee.com/vesoft-inc/…

Project Introduction:

Nebula is a distributed, scalable, open source graph database specializing in processing hundreds of billions of vertices and trillions of edges in extremely large data sets. The founding team of the company is drawn from Facebook, Alibaba, Huawei, and many other well-known domestic and international companies.

productionProduct architecture:

gStore

Open source license: BSD-3-clause

Project Author: PKUMsOD

Project Address:Gitee.com/PKUMOD/gSto…

Project Introduction:

GStore is a kind of RDF data management system based on Native Graph Model. It is developed by data Management Laboratory (PKUMOD) of Wang Selection Computer Institute of Peking University led by Prof. Zou Lei.

productionProduct architecture:

matrixone

Open Source license: Apache-2.0

Project author: MatrixOrigin

Project Address:Gitee.com/matrixorigi…

Project Introduction:

MatrixOne is a distributed cloud native converged database designed for heterogeneous mixed workloads.

Architecture Display:

Said in the last

Many excellent and innovative open source database projects have been born in the train of domestic database to the future. Now, a new generation of scientific and technological revolution and industrial innovation has arrived, in this complicated technological track, how to go next, no one has an accurate answer.

How far can domestic database go after all? Is the gap with foreign advanced products widening or narrowing? These are all unknowns.

But now we can make it clear that if we can build a good database ecology and give domestic substitutes a healthy forward market environment, we can certainly create a road that only belongs to us in this turbulent era.