Goodbye 2021, hello 2022!
“Meituan Technical Team” wechat public account wishes everyone a happy New Year! As a New Year gift, we’ve selected 22 tech articles based on the number of articles “read” and “read”, as well as the tech fields they cover. I hope that in 2022, I will continue to work with you to practice and forge ahead.
In order to make better content, we would like to hear your opinions and suggestions on topic selection from 2022. We have prepared a survey questionnaire, you are welcome to help fill it out. We will select 5 partners and send them beautiful keyboard holders from Meituan Gift Shop (the deadline of this event is January 6, 2022).
The 11 most “read” tech articles of 2021
How do I gracefully log operations| reading quantity 42391
Operation logs exist on almost every system, and these systems have a set of apis for logging operations. Operation logs are different from system logs. Operation logs must be easy to understand. So how do you decouple operation logs from business logic? How do you make the contents of operation logs easy to understand? How do you make access to operation logs easy? These are the questions to be answered in this article. This article focuses on how to gracefully log operations.
Construction and application of script standardization based on knowledge graph of Meituan| reading quantity 30035
As an emerging business with explosive growth, playbook has shortcomings in order placing by merchants, purchasing by users, matching between supply and demand, etc. Supply standardization can create value for users, merchants and platforms, and boost business growth.
This paper introduces the process and algorithm scheme of meituan to store integrated business data team’s rapid construction of script supply standardization from 0 to 1. We covered meituan store GENE (GEneral NEeds Net) to the script killing industry, constructed the script killing knowledge map, and realized the construction of supply standardization, including the mining of script killing supply, the construction of standard script library, the association between supply and standard script, etc., and implemented the application in multiple scenes.
Construction and application of Meituan commodity knowledge graph| reading quantity 24601
As the cornerstone of the digitalization of the new retail industry, the Product knowledge map provides a precise structured understanding of the product and plays a crucial role in business applications. Compared with the original merchant mapping in Meituan Brain, the commodity mapping needs to deal with more dispersed, complex and massive data and business scenarios, and faces challenges such as low quality information sources, multiple data dimensions, and reliance on common sense and professional knowledge. This paper will focus on the knowledge map of retail commodities, and introduce meituan’s exploration in commodity hierarchy construction, attribute system construction, and human efficiency improvement of map construction.
GraphQL and metadata-driven architecture practices in back-end BFF| reading quantity 22247
GraphQL is a data query language proposed by Facebook. Its core features are data aggregation and on-demand. It is widely used between front and back ends to solve the problem of flexible use of data by clients. This article introduces another practice of GraphQL. We sank GraphQL below the Backend BFF (Backend For Frontend) layer, combined with metadata technology, to implement on-demand query and execution of data and processing logic. This not only solves the problem of flexible use of data in the back-end BFF layer, but also directly reuses the processing logic of these fields, greatly improving the efficiency of research and development.
Meituan takeout real-time number warehouse construction practice| reading quantity 21767
This paper mainly introduces a general method and practice of real-time data warehouse construction. Real-time data warehouse to end-to-end low latency, SQL standardization, rapid response to change, data unity as the goal. The best practice concluded by meituan Takeout Data Intelligence team is: a common real-time production platform and a common interactive real-time analysis engine work together to meet both real-time and quasi-real-time business scenarios. The two reasonable division of labor, complement each other, form easy to develop, easy to maintain and high efficiency assembly line, give consideration to development efficiency and production cost, with a better input-output ratio to meet the diversified needs of business.
Meituan wine travel data governance practice| reading quantity 20692
Data has become a lot of the company’s core assets, and in the process of data development will introduce all kinds of problems, such as quality, efficiency, security and data management is to continuously introduced to eliminate these problems, ensure the data accurate, comprehensive and complete, create value for the business, at the same time, strict management of data permission, avoid data reveal that the business risk. Data governance is a very important core capability of many companies in the digital era. This paper introduces the practice of data governance in Meituan Hotel & Tourism platform.
Exploration and practice of FlutterWeb performance optimization| reading quantity 19642
The technology of Meituan takeout merchant terminal based on FlutterWeb has been explored for a long time. At present, multi-terminal reuse of App, PC and H5 has been implemented in many businesses, effectively improving the overall efficiency of production and research. In this process, performance is the biggest challenge we face. Considering the actual business scenarios, this paper introduces the exploration and practice of Meituan Takeout merchants in FlutterWeb performance optimization.
Design and implementation of Ten billion API Gateway service Shepherd| reading quantity 19591
In microservices architecture, service fragmentation multiplies the size of apis, and it is becoming a trend to use API gateways to manage apis. In this context, Meituan unified API gateway service Shepherd came into being. It is suitable for Meituan business and fully developed by itself. It is used to replace the traditional Web layer gateway application, and business developers can open functions and data to the outside world through configuration. This paper will introduce the background of the birth of Meituan unified API gateway, the design and implementation of key technologies, and the future planning of API gateway.
Exploration and application of emotion analysis technology in Meituan| reading quantity 18820
In May 2021, MEituan NLP center opened source ASAP, the largest Chinese attributed-level emotion analysis data set based on real scenes so far. Related papers of this data set were accepted by NAACL2021, and the data set was added into the Chinese open source data plan. Will work with other open source data sets to advance Chinese information processing technology.
This paper reviews the evolution of Meituan sentiment analysis technology and its application in typical business scenarios, including discourse/sentence level sentiment analysis, attribute level sentiment analysis and opinion triplet analysis. In business application, the online real-time forecasting service and offline batch forecasting service are constructed based on the ability of sentiment analysis technology. So far, sentiment analysis service has provided services for more than 10 business scenarios within Meituan.
Practice of multi-service modeling in Meituan search sorting| reading quantity 18124
This paper shares the modeling and optimization work of multi-business sorting in Meituan search. We mainly focus on the multi-business scenario of store-to-store merchants. The subsequent content will be divided into the following four parts: The first part is a brief introduction to the hierarchical architecture of Meituan search sorting; The second part will introduce multi-service fusion modeling on multi-channel fusion layer. The third part will introduce the multi-service sequencing modeling of the precision scheduling model. The last part is summary and prospect.
Spock unit testing framework and optimization practices in the United States| reading quantity 15531
Spock is an excellent testing framework based on BDD (Behavior Driven Development). Spock combines Groovy’s dynamic language features with a variety of tags and a simple, generic, structured description language to make writing test code simpler and more efficient. At present, Most of meituan Preferred Logistics back-end services have adopted Spock as the testing framework, which has achieved good benefits in terms of development efficiency, readability and maintainability.
The 11 most “viewed” tech articles of 2021
How to achieve speed and compression ratio? Optimization of compression algorithms in build deployment| look at the number 3279
Compression often plays a very important role in data transmission and storage, so improving the efficiency of compression can help us save time and reduce storage costs. This paper introduces the application of compression algorithm optimization in the construction and deployment platform, which can help the R&D team improve the efficiency of r&d and delivery.
Design and implementation of Kafka application layer cache architecture based on SSD| look at the number 3254
Kafka in Meituan data platform to assume the role of unified data cache and distribution, for the PageCache mutual pollution, which leads to the PageCache competition caused by real-time operation is delayed operation of the pain point, Meituan based on SSD self-developed Kafka application layer cache architecture. This paper mainly introduces the design and implementation of the architecture, including the scheme selection, comparison with other alternatives and the core thinking points of the scheme, and finally introduces the performance comparison between the scheme and other alternatives.
Make the Flutter run on the Hongmeng system| look at the number 3155
HarmonyOS is a distributed operating system developed by Huawei. How do you quickly migrate mobile applications to HarmonyOS at a relatively low cost while ensuring the efficiency of development iterations? The MTFlutter team of Meituan Takeaways recently conducted a technical exploration and successfully implemented the native support of Flutter for Hongmeng systems.
Autonomous Driving Trajectory Prediction algorithm: NeurIPS Challenge Champion scheme| look at the number 2931
Meituan Unmanned Vehicle Distribution Center team won the NeurIPS 2020 INTERPRET Trajectory Prediction Challenge Generalizability Track Champion and the Regular Track runner-up. This paper introduces the algorithm level.
A tool that can speed up compilation of large iOS projects by 50%| look at the number 2163
This article introduces a cocoapods plug-in developed by Meituan platform, which can greatly improve the compilation speed of iOS engineering code. The first half of the article mainly introduces the relevant principles, and the second part mainly expounds the practice in the engineering level.
Construction and practice of Meituan takeout characteristic platform| look at the number 1974
With the development of Meituan takeout business, the algorithm model is also evolving and iterating. This paper introduces the thinking and optimization of Meituan takeout feature platform in construction and practice from four aspects of feature framework evolution, feature production, feature acquisition calculation and training sample generation.
OCTO 2.0: A Service governance system based on Service Mesh| look at the number 1616
OCTO 2.0 is the next generation distributed Service governance system of Meituan. Based on the combination of the existing Service governance system OCTO 1.0 and the Service Mesh communication infrastructure layer, OCTO 2.0 is a new evolution version of Service governance functions such as naming Service, configuration management, performance monitoring, and traffic limiting authentication. This article mainly describes the important functions and implementation ideas of OCTO 2.0.
The practice of FlutterWeb in Meituan Takeout| look at the number 1369
In the multi-form business scenario, how to ensure the consistency of multi-end experience is a relatively concerned direction in the field of front-end technology. Meituan takeout front-end technology team explored cross-terminal (App\PC\H5) solutions based on FlutterWeb and truly realized “Write Once & Run AnyWhere”. This paper is a summary of the practical experience of the team.
Design draft (UI view) automatic code generation scheme exploration| look at the number 1037
The conversion of design draft (UI view) to code is the daily repetitive work of front-end engineers, which has a low complexity but a high proportion of work. Therefore, improving the efficiency of design draft to code has always been one of the directions that front-end engineers pursue.
Previously, front-end engineers tried to modular business components into a general visual library, and to build business modules through drag and drop, splicing and other forms, so as to realize view reuse and reduce the r&d cost of design draft to code. However, with the development of business and the drive of individuation, the universal vision library cannot cover all application scenarios. This paper proposes a scheme of automatic code generation for design draft.
Meituantu database platform construction and business practice| look at the number 807
Graph data structures that better represent the real world. Meituan business is relatively complex, there are more graph data storage and multi-hop query requirements, there is an urgent need for a component to manage hundreds of billions of scale graph data, efficient storage and query of massive graph data is the core topic of graph database research. This paper introduces some work of Meituan in graph database selection and platform construction.
After that, let’s talk about how do we do good threat modeling| look at the number 540
For meituan security team, it is our unremitting pursuit to introduce the leading security technology design capabilities and build a comprehensive and multi-dimensional intelligent defense system. Meituan has a lot of infrastructure and core business systems that require a mature methodology for threat assessment. This article will focus on how threat modeling helps Meituan security teams assess and discover the risks of a large number of security designs, and how Internet enterprises should implement threat modeling on a large scale and fully implement it.
Note: The data is collected at 16:00 on December 30, 2021, and the articles listed in both lists have been de-processed.
Write in the back
Once again, we invite you to help fill out the survey questionnaire on the official account of Meituan Technical team. We welcome your valuable comments or suggestions. We look forward to growing up together in the future.
On December 4, 2013, the blog of Meituan technical team was born and published its first article. More than 8 years, 2948 days, we have published 483 technical articles, meituan technical team blog/public account, thank you for your company all the way!
Finally, I wish you all health, peace and strength in 2022.
Read more technical articles from meituan’s technical team
Front end | | algorithm back-end | | | data security operations | iOS | Android | test
| in the public bar menu dialog reply goodies for [2020], [2019] special purchases, goodies for [2018], [2017] special purchases such as keywords, to view Meituan technology team calendar year essay collection.
| this paper Meituan produced by the technical team, the copyright ownership Meituan. You are welcome to reprint or use the content of this article for non-commercial purposes such as sharing and communication. Please mark “Content reprinted from Meituan Technical team”. This article shall not be reproduced or used commercially without permission. For any commercial activity, please send an email to [email protected] for authorization.