Database technology has been IT a very important part of the information technology, after enter cloud native era, the development of the distributed database system won the exciting, cloud infrastructure and further integration of database, to make up for the pain points of traditional database, bring the high scalability, full automation, rapid deployment, cost saving, convenient management and other advantages.
Bytedance’s core technology concept is data-driven and agile development. As of December 2, 2021, the total amount of data in Bytedance’s data warehouse has reached 9,500 PB, with 40 PB data added every day and more than 27,000 indicators. Under such massive data scale, the data platform is required to have high data accuracy, consistency and stability.
A wide variety of businesses; Too much data and high costs; The challenges of fast business growth and ever-changing demands put higher demands on the underlying technical capabilities of byte database. How to design a future-oriented, cloud biogenic database system? What is different about a byte-generated database? What is the future direction of cloud database development? This is the core question that will be shared in this technology salon of Byte Cloud Database Architecture Design and Practice.
Bytedance Technology Salon free registration channel is now open, click here to register!
Speech topic
Past, present and future of Bytedance database
Content abstract
Explain the development history of Bytedance database, and introduce bytedance database product matrix; This paper analyzes several driving factors in the process of database evolution, and looks into the future database products and technology system.
The audience gains
- Understand the development process of Bytedance database;
- Understand the characteristics of bytedance database product matrix;
- Understand the main product and technology driving factors in the development process.
A guest speaker
Lei Zhang, Senior engineer of Bytedance Infrastructure database
He joined ByteDance in 2019 and has more than 10 years of database storage r&d experience. Currently, he is responsible for the R&D, operation and maintenance of infrastructure database (RDS, veDB, ByteDoc, etc.), OBJECT storage TOS, big data storage HDFS and other products.
Evolution from single machine to distributed database storage system
Content abstract
In the traditional database products, the stand-alone database is still the main force, but with the increase of user data volume and database access pressure, the traditional stand-alone database is increasingly weak. As ByteDance explores distributed databases, storage systems are also evolving from stand-alone to distributed. This lecture will explain the distributed storage system behind the byte self-developed database, and share the evolution and practical experience of large-scale database storage system.
The audience gains
- Knowledge of common database storage models;
- Understand the architecture and technology of byte self-generated distributed storage;
- Understand how distributed storage serves distributed databases.
A guest speaker
Ma Haoxiang, Bytedance Infrastructure database development engineer
After graduating from Northeastern University, HE joined byteDance infrastructure team as a database development engineer. He focuses on distributed databases, high performance computing and storage technologies. After joining Bytedance, he continued to participate in the development of cloud native distributed database, and was responsible for the exploration of cutting-edge technologies in the field of high-performance storage components and database.
VeDB (for MySQL) computing engine practice and challenges
Content abstract
VeDB (for MySQL) is a distributed database that uses a cloud native storage separation architecture and is fully compatible with MySQL 8.0. The product has been launched in large number of bytes and will soon debut in the Volcano Engine public beta. This presentation will give you an overview of the process of building the computing engine for this distributed data product, typical technical problems and solutions, and finally discuss some of the future development directions of the product.
The audience gains
- Understand computing storage separation architecture;
- Understand some technical problems of distributed database construction under computing and storage separation architecture;
- Understand the demands of typical byte business for distributed database and corresponding solutions.
A guest speaker
Nie Yuanyuan, Bytedance Infrastructure database development engineer
He graduated from Huazhong University of Science and Technology in Wuhan and has more than 10 years of database kernel development experience. He used to work for IBM/Teradata/ Huawei. He joined bytedance infrastructure team in 2019 and is now responsible for veDB (for MySQL) technology direction and the team he works for. Focus on distributed database and distributed storage technology. After joining Bytedance, I participated in the construction of veDB (for MySQL) products from scratch, and have launched a large number of applications in Bytedance.
Exploration and practice of future development direction of byte cloud database
Content abstract
The explosive growth of Internet data storage and the large-scale commercial use of AEP+RDMA bring new opportunities and challenges to the development of cloud database. This lecture will introduce the exploration and practice of byte internal database system in the future development direction. It includes the multi-master architecture, the development and evolution of HTAP system, the exploration of the application of new hardware AEP+RDMA in database system, and the future product direction.
The audience gains
- Understand the future development directions of byte cloud database system;
- Understand the evolution of byte cloud databases from single to multi-master architectures;
- Understand the use of new AEP+RDMA hardware in the direction of database;
- Learn how to build a one-stop data platform with the HTAP database.
A guest speaker
Huicong Liu bytedance Infrastructure database development engineer
He graduated from The Institute of Computing Technology, Chinese Academy of Sciences. He used to work for Baidu and has been engaged in the research and development of distributed database. In 2019, he joined bytedance infrastructure team as a database development engineer. Focus on distributed database and distributed storage technology. After joining Bytedance, I participated in the construction of veDB (for MySQL) product and was responsible for the research and development of computing engine.
Sign up for free
Sharon is introduced
Bytedance Technology Salon is a technical exchange activity initiated by ByteTech, a bytedance technology community, for developers from all over the industry. By building an inclusive, open and free exchange platform, it promotes the popularization and implementation of cutting-edge technologies and helps technical teams and developers grow rapidly. Bytedance Technology Salon’s technology sharing comes from bytedance’s front-line technical experts, providing technical teams and developers with a variety of technical feast for reference based on hot technical direction and practice summary.
Free registration link:
www.bagevent.com/event/80497…