Abstract: For enterprises, building a unified data base can make the data supply and business side more efficient, more secure, and easier to share. With the rapid development of technology, it is not difficult to migrate to the cloud, but it is still a huge challenge in the industry to migrate to the cloud from heterogeneous databases (changing database types).
This article is shared from Huawei cloud community “130,000 tables, hundreds of millions of lines of code, Huawei Cloud UGO power heterogeneous database migration only hours to complete!” , original author: Scheming fat.
At present, cloud office, cloud transactions, cloud digital operation has become the mainstream, not to deploy business to the cloud, it seems that the pace of The Times. For enterprises, building a unified data base can make data supply and business side more efficient, more secure, and easier to share. With the rapid development of technology, it is not difficult to migrate to the cloud, but it is still a huge challenge in the industry to migrate to the cloud from heterogeneous databases (changing database types).
Huawei group is a multiple formats, long chain of enterprise, the whole scene, in 20 years ago began to use the database, in the fields of research and development, supply, finance, administration, offline scenarios, real-time scene, several positions, such as usage scenario, these scenes using mainstream commercial database, along with the digital transformation process is accelerated, in terms of iteration, to keep up with the rhythm of the cloud, Therefore, Huawei Group process IT joined hands with Huawei Cloud database to seek cloud transformation.
For huawei group process IT, which has massive data, a variety of database types and database experts, IT is not easy to go on the cloud. The “two legs” principle prevails in the industry, which is to be fast, economical and safe, stable and reliable. Of course, Huawei Group is no exception. Faced with a new heterogeneous database, huawei Group process IT chooses to relocate services to Huawei cloud database RDS and GaussDB to ensure both performance and security. Compatibility and performance are the biggest challenges in heterogeneous database migration.
The “Deep Pit” of Heterogeneous Database Migration
Migration database as move, move directly is not feasible, need to move first “house main body”, and then move “furniture in the house”, etc., which involves the migration problem is not only complex, and can not go wrong. Especially the troublesome compatibility problem, not only involves the structure migration, syntax conversion, SQL conversion and other complex operations, the database performance requirements are also very high.
Huawei Cloud UGO was born for automated relocation
First of all, Huawei Cloud database and Huawei Group process IT conduct a comprehensive assessment of the business. Huawei Group database has hundreds of thousands of tables, 100,000 levels of stored procedures, codes of stored procedures over 100 million levels of codes, hundreds of thousands of task scheduling, and the amount of migrated data is up to several TB. After the evaluation, the application manual transformation work is huge, and mature enterprise-level end-to-end object migration or evaluation tools are needed to improve the conversion rate of heterogeneous database migration.
The key technologies used are: 1) * * migration workload evaluation: * * on the basis of massive business scenarios as a baseline assessment of actual human migration cost, on the basis of a large number of business scenarios migration process automation, accumulative total migration effort as input, at the same time, combine the code, conversion rate, incompatible feature transformation difficulty, convenient for the customer to the migration work has a specific quantitative perception. **2) Application OF SQL migration: ** Data is migrated to the target library in the form of traffic simulation playback by collecting SQL traffic from the source library and dynamically converting SQL, providing automatic error location and migration verification, and the revised objects are clear and clear during migration. At the same time, through migration evaluation and SQL translation of source database, and output SQL translation report, complete application transformation, and finally migrate to the target database.
Fast Light, Huawei Cloud UGO hour level completed relocation
Huawei Group process IT has several TERabytes of data and hundreds of thousands of stored procedures. The migration cycle has been shortened from days to hours, reducing the cost of stored procedure transformation by 50%, supporting the migration of 500+ Schema of mainstream commercial databases, saving 70%+ workload and 1000+ migration sets.
In a typical case, the migration cycle and evaluation of all aspects takes 1-2 months, and the migration cycle is also calculated in days, whereas UGO completed the migration in hours. Huawei cloud UGO eliminates the difficulties, long cycle and high cost of heterogeneous database migration, and effectively supports the IT digital transformation of Huawei Group process. In addition, after the implementation of cloud, minute-level expansion of database and second-level data entry are realized, which solves the problems of difficult expansion of traditional database and great pressure of data entry, and can support the data volume of logical database at the level of hundreds of millions. After the transformation of micro-service, it is expected to support two years of business data growth.
At present, Huawei cloud database application migration solution has successfully passed the evaluation of “Database application Migration Service Capability” by THE Information and Communication Institute, becoming the first commercial database migration solution to pass this evaluation in China and achieving the highest score in the first batch of evaluation in China. In the future, Huawei Cloud UGO will continue to innovate, continue to build technical hard power, and provide customers with more easy-to-use, efficient and reliable migration solutions.
Huawei Cloud UGO hot public test, immediately free experience ~
Click to follow, the first time to learn about Huawei cloud fresh technology ~