I wish the whole world developer friends, New Year career development tiger roar wind, New Year wage growth, New Year love fortune Tiger Jump Longxiang, New Year code accident under the tiger mouth escape, tiger! The tiger! The tiger!
The myth of the Man-month, the software engineering bible, once said that “software development has no silver bullet”, and it is true that complex software engineering problems cannot be solved with simple answers. At Bytedance, massive data, complex business scenarios and rapidly growing business scale all pose more or less challenges to mature open source technology solutions in the industry. Bytedance’s technical teams have fully investigated the mature solutions in the industry and developed a number of solutions and tools with excellent results based on the actual business conditions. Some of these solutions have been open source and some have been integrated into volcano Engine service. More solutions will be opened to the industry after being polished and matured internally.
The following is a collection of self-developed technical solutions published by bytedance’s technical team on its official account in the past year.
Byte Engineers develop the ultimate documentation suite based on IntelliJ
It is well known that there are four things programmers hate most: commenting, documenting, others not commenting, and others not documenting. Therefore, it is necessary to find ways to reduce the cost of documentation and maintenance. In order to solve the many pain points of writing the original mode of documents, the intellij-based ultimate document suite solution developed by Byte Engineers can be completely separated from the browser/document editor, and the synchronization of online pages is completely left to the automatic deployment triggered by timing.
👉 Review details here
Byte self-developed Android VIRTUAL machine memory management optimization black technology mSponge
MSponge, an Android VIRTUAL machine memory management tool developed by Byte, reformed the Memory management of Android virtual machines from the perspective of application, optimized the memory management strategy of LargeObjectSpace of virtual machines, and indirectly increased the upper limit of other memory space usage. After the modification, the LargeObjectSpace 32-bit runtime environment can be up to 2 gb or more memory usage limit (64-bit environment usage limit theoretically tends to be infinite). Through this solution can solve the memory bottleneck and OOM problem that many applications will encounter from the system side to the greatest extent, one key access, safe and reliable.
👉 Review details here
Monolith is a massive Training & Serving solution
Monolith is byte beating volcanic engine intelligent large-scale Training and Serving scheme in recommended platform, including the Training/Serving/Parameter Sync, etc., is a set of complete system solutions. Compared to other systems in the industry, Monolith has successfully addressed multiple challenges with the following features: Monolith solves TensorFlow’S PS communication bottlenecks, all-embracing fault tolerance, distributed Serving, and performance optimization. Monolith has proven its performance, stability, and performance in a wide variety of applications, including ecommerce, community, and video, through its recommendation platform. In the future, we will continue to iterate at a high speed to optimize the user experience and platform functionality.
👉 Review details here
Atop, the byte-optimized version of the performance testing tool
Atop is an open source stand-alone performance monitoring tool that supports real-time observation and troubleshooting by reading historical files. In addition to providing global indicators such as CPU, MEM, and DISK, it also provides monitoring data of various indicators at the process and thread level. Optimized based on the community atop, Bytedance has iterated three versions of atop for nearly three years, and added NUMA aggregation, JSON format output, interactive interface improvement, log-related improvement and other feature optimization.
👉 Review details here
Developed the OpenBMC solution
OpenBMC is a project of the Linux Foundation, and is currently the most mature and active project in the open source BMC community. OpenBMC developed by STE team of Bytedance System Department has been successfully launched internally and has been running stably for more than four months. This is the first OpenBMC solution officially launched and initially productized by ByteDance. In addition, STE engineers have submitted several commits to the OpenBMC Technical Oversight Forum (TOF) that relate to new features and bug fixes.
👉 Review details here
Self-developed simultaneous transmission system “Volcano simultaneous Transmission”
At the 2021 Beijing Wisdom Source Conference, the product “Volcano Simultaneous transmission” launched by Huoshan Translation provided “low-delay and high-quality” simultaneous subtitles for the conference live and online broadcast, which helped the conference to be held smoothly. Bytedance AI-Lab intelligent speech team has made many attempts and exploration on RNN-T model. Through continuous data accumulation and algorithm optimization, the self-developed end-to-end speech recognition system based on RNN-T model has achieved significantly better performance than the CTC model, and has been applied in many businesses such as conference transcription and simultaneous transmission. They all got good feedback.
👉 Review details here
Self-developed intelligent test system Fastbot
Fastbot is a client intelligence testing tool developed by Byte, mainly suitable for client stability/compatibility/stress testing. Fastbot now supports multiple platforms: Android, iOS, Web, PC, etc. At present, Fastbot has been widely used in stability testing and compatibility testing of byte client products. More than 10,000 tasks are started daily, and more than 50,000 crashes are found every month on average. With Fastbot’s capabilities, we were able to fix the majority of crashes before release, ensuring a good experience for online users. At the same time, Fastbot plays an important fundamental service role in the entire DevOps process. The iOS and Android versions are open source.
👉 Review details here
Self-developed intelligent integration scheme Pitaya
Pitaya is an end-to-end (cloud) full-link dynamic deployment solution jointly built by byteDance mobile platform team and MLX team. Pitaya is an integrated solution of terminal intelligence specially designed for mobile terminals. Compared with traditional solutions, Pitaya has the following advantages: It reduces the cost of using terminal intelligence, facilitates rapid business integration and gains business benefits; Perfect dynamic capability to support fast iteration and validation of the model; Improve the efficiency of multi-party collaboration and let algorithm engineers deeply participate in client scenarios; The algorithm and model are highly reusable, which can promote the verified scheme quickly. At present, Bytedance has started the practice and exploration of end intelligence based on Pitaya in many product lines such as Tiktok, Toutiao and Watermelon. In the future, new functions such as feature engineering, model self-development and general AI capacity building will be planned.
👉 Review details here
The next byte technology Annual product preview: practice