Recently, at ArchSummit global Architect Summit, Tencent billing team shared their in-depth practice on TDMesh, a core financial transaction solution. This is also Tencent billing after the first offline display at Tencent global Digital Ecology conference in May this year, another big move.
It is understood that Tencent billing is an Internet trading platform incubated to support Tencent’s internal business revenue of hundreds of billions of yuan. It brings together mainstream payment channels at home and abroad and provides multi-dimensional services such as account management, precision marketing, security risk control, audit and ledger distribution, billing analysis and so on. The platform bears the revenue market of Tencent, with tens of billions of accounts and daily transactions, covering 180+ countries (regions) and serving tens of thousands of businesses and millions of merchants. It is a comprehensive one-stop billing platform.
TDMesh is incubated from the billing technology system that has supported Tencent for 15 years. It consists of multiple functional modules such as global consistency, massive request support, 7*24 uninterrupted service management, second-level intelligent monitoring and elastic scaling, etc. Together, it forms a comprehensive financial-level processing solution.
Li Gang, General Manager of Tencent Billing Platform Department, said, “Based on the challenges of high consistency, high performance, high availability and high reliability of billing, Tencent Billing Platform Department, based on years of experience in internal business services, comprehensively optimized and integrated the core technology segment, and launched a set of financial level core transaction solution TDMesh. At the same time of continuous self-improvement, we also hope to participate in relevant technical discussions and build a financial level consistent technology paradigm together with our partners to promote the development of the industry.”
To deal with the “four high” challenge, Tencent billing technology construction ideas
The infrastructure construction of Tencent billing system started in 2004. In the following 15 years of development, Tencent has faced a series of challenges in billing with the increase of access services, the rise of mobile payment and regional globalization of deployment. For example:
· Consistent financial grade. Tencent Billing carries storage of game accounts, integral rights and interests, pan-entertainment subscriptions, advertisers and other accounts worth tens of billions of yuan. The transaction peak is hundreds of thousands of yuan per second, and the daily transaction volume is over ten billion yuan. The average version or process change is over one hundred items per day. Under the huge transaction scale, how to ensure zero error of billions of years of revenue and achieve financial consistency is the core key problem of accounting.
· High performance. Billing process, such as game point coupon consumption, per-click advertising fee, etc., visits are frequent and often accompanied by hot spots. In addition, if the traffic burst tens of times during activity volume, the superimposed instantaneous peak value exceeds one million TPS, which requires high stand-alone performance and overall redundancy of billing.
· High availability. Billing service at present, the world has deployed 100 + cluster, as a large span of the payment system, is bound to face all kinds of network anomaly, differences of different countries pay channels, configuration and data processing of difficult problems, such as these require billing services have a strong business disaster and disaster data capacity, have good flexibility and fault tolerance design, The unavailable time is controlled at the annual minute level;
· High reliability. Mainly for the storage layer, as long as the response is successful on behalf of the data must fall disk, for such as operating system crash and other unexpected downtime to ensure that data is not lost; At the same time, the failure of any distributed node, caused by local data damage and brain crack and other problems, but also require strict good data not lost.
In order to cope with the above “four high” challenges, Tencent billing adopts two major design ideas in terms of technology: micro-service and Zhongtaihua.
Microservice design, through reasonable function splitting, and fine service governance such as service registration, discovery, fusing, self-healing, load balancing, link tracking to achieve rapid function expansion and efficient traffic scheduling, so as to achieve high scalability and high availability of the whole system.
Through reasonable function organization, clear module boundary, internal componentized abstraction of the same logic, and unified service authentication, inter-service configuration, intra-service transaction, and unified storage of the service, to achieve high reusable overall service, improve the research and development efficiency.
Based on the above ideas, Tencent accounting has built a financial accounting solution TDMesh, which covers from access to storage. Each link has four components with high requirements, plus management and control modules such as service scheduling, monitoring, gray scale change and data analysis in operation. These modules cooperate with each other to support the business development of Tencent billing and external partners.
TDMesh has been recognized by the industry
From the perspective of technical architecture, TDMesh has formed a complete and rich technical product system.
For developers, after using TDMesh, APP can access all components of TDMesh in one step as long as it is connected to TDXA, so as to realize package standardized processing of the whole transaction business chain from configuration, access, application layer transactions, order storage, message communication and account checking, so as to realize the four high requirements of high consistency of its own services.
Up to now, the distributed database TDSQL developed by Tencent Billing, one of the components of financial solution TDMesh, has supported the core business system of Rural Commercial Bank of Zhangjiagang, Jiangsu province, the first traditional bank in China, to transform into a new generation of distributed core business system and realize independent control. This distributed database product has also been opened up to partners; At present, TDSQL database has provided database services for more than 500 public cloud customers, bank of China and nearly 30 proprietary cloud customers.
In this release, TDMesh components are mainly introduced, including TDXA, which solves application layer transactions, and TDMQ, which is responsible for system decoupling and transaction exception handling. TDXA (Tencent Distributed eXtended Architecture) is a Distributed transaction scheduling engine that aims at long link consistency, supports mixed transaction modes and graphical development. It supports transaction modes, such as TCC/Saga/AT; Its orchestration ability, mainly through the process state jump tracking to automatically confirm or roll back, and zero manual intervention when abnormal; Its development mode is mainly graphic one-stop integrated research and development platform; In this way, the complex distributed consistency problem is finally handed over to the platform, which makes the business development more focused, simplifies complexity, and improves the fault tolerance and stability of the system.
A typical feature of TDMQ cloud native is that it supports separation of storage and computing, with the upper computing layer consisting of independent brokers supporting high performance network access and topic management, and the lower storage layer implementing high consistent replication of log flows. In this way, it is possible to scale separately according to business performance or capacity requirements to achieve overall cost optimization. Typical features of TDMQ include delayed messaging, transactional messaging, message tracking, full multi-tenant support, and arbitrary number of consumers, which are friendly for scenarios such as high concurrent consumption. In addition, in operation, it also supports fast data smooth migration, logical isolation and other features to avoid the mutual influence of production and consumption among multiple topics.
Finally, as a technical product dedicated to financial core transaction package solutions, we hope to continue to polish and improve the ease of use, manageability, performance-cost ratio, cloud native adaptation and other aspects through richer scenarios and customers at the same time of in-depth practice and summary. These concepts are also being implemented and developed in Tencent, post-investment companies, cloud customers, intelligent industry and other fields. TDMesh is expected to add new ideas and practical cases for the development of the industry through continuous forging of technologies and products.