In this huge treasure house of the community, we first enjoy the results of open source projects, which greatly improve the development efficiency, so that we do not have to detour, do not have to repeat the wheel, and can move forward faster.
– – – li.
ApacheCon is the official global series of conferences of the Apache Software Foundation (ASF). ApacheCon is one of the most celebrated events in the open source world and one of the early days of the open source movement.
Back in 1998, before the ASF was founded, ApacheCon had attracted participants at all levels to explore the “technologies of tomorrow” in more than 300 Apache projects and their various communities. It was also during this session that the developers of HTTPD services got together and decided to form the Apache Software Foundation.
ApacheCon is held annually in Europe or North America and is a great opportunity for Apache developers to meet, discuss, and share ideas. Demonstrate the latest developments and innovations in the Apache project through hands-on presentations, keynote speeches, real-life case studies, training, hackathons, and more.
This year, in order to better serve the rapidly growing number of Apache users and contributors in Asia Pacific, the ApacheCon Organizing Committee and the Apache Software Foundation are pleased to announce that ApacheCon Asia, the first online conference for Asia Pacific time zones, will be held on August 6, 2021.
In order to give you a better understanding of Open Source and ApacheCon Asia, SegmentFault will interview some Track chairs or conference lecturers to let you know the background of the conference preparation and the stories of these experts.
Today, we are bringing you an interview with Li Lei, the committer of Apache BRPC.
The following is the interview content of SegmentFault Sifeng with Li Lei:
About li.
Hello, everyone, I’m Li Lei, a graduate of Xi ‘an Jiaotong University. I’m now an infrastructure engineer in Bytedance, engaged in R&D of map database and distributed KV, and a committer of Apache BRPC (incubator).
The story of Li Lei’s first contact with open source
I first came into contact with open source when I was working there, when I used MapReduce in Apache Hadoop for offline work. At that time, in order to optimize the running time of the job, I optimized a MapReduce job into a MapOnly task, but I also encountered some problems at that time. When the Mapper task on a machine is completed and the machine is down unfortunately, the previously completed Mapper task will be re-executed. For MapOnly tasks, there is no need to re-execute them, so there is a lot of room for optimization. Under the guidance of a Hadoop Contributor colleague, I completed a fix for this issue and contributed to the community.
In subsequent projects, to optimize RPC overhead, I introduced Apache BRPC (Incubating) into the program, learned, participated in the community, added some features, fixed some bugs, and engaged in the open source community in greater depth and learned a lot from it.
What have individuals and companies gained from participating in open source and contributing to the Apache community?
By participating in open source, we first enjoy the achievements of open source projects in the massive treasure house of the community, which greatly improves the development efficiency, so that we don’t have to take detours and repeat the wheel, and can move forward faster. Of course, while enjoying the results, we also actively give back to the community and make a modest contribution to the community. During this period, I got to know a lot of excellent seniors, learned more in-depth technology in practice, helped a lot of users in the community, and also made myself grow faster.
What does Li Lei understand about “The Apache Way”?
My understanding of “The Apache Way” is at its core about sharing. Many of the best projects have been shared with the Apache community and have matured with the efforts of many developers in the community. Each developer shares his or her own innovation, allowing the project to take root and thrive in the community. Human progress has always been like this. Through sharing, people can constantly step on the shoulders of giants, and this idea is vividly reflected in the Apache community. The community has gathered the wisdom of countless developers, and has opened the door to every developer in the world to continue to innovate and share what has been accumulated, driving the rapid development of software technology.
Li Lei and ApacheCon Asia
The Track I’m in is Incubator, and the topic of my talk is “The BRPC-based practice of Bytedance distributed graph database”. ByteGraph is a distributed graph database developed by Bytebeat itself. It supports the storage of super-large graphs with a data scale of trillions of edges, and a single cluster supports tens of millions of read-write QPS, with a total operating scale of nearly ten thousand servers. In such a large scale scenario, ByteGraph relies on BRPC to provide high-performance, easy-to-use, and stable RPC framework support. This share will introduce you to ByteGraph and BRPC, respectively, as well as practical experiences with large-scale distributed systems like ByteGraph based on BRPC.
BRPC is an excellent C++ RPC framework, has been used in many companies and many scenarios, of course, there are some friends may not know it. I hope to share with you the design ideas of BRPC, BRPC use experience, and how to solve some problems that may be encountered. I hope these experiences can give you some references and help you in your work.
Join us at ApacheCon Asia!
Here is the industry’s cutting-edge technology, excellent ideas, come quickly!
About the Apache BRPC (Incubating)
Apache BRPC (incubator) is an excellent industrial-grade C++ RPC framework, which is compatible with many protocols and easy to develop, and has excellent performance, excellent stability, and a wealth of peripheral tools. So far, many companies have used BRPC in a large number of projects, including Baidu, iQIYI, Bytedance, Bilibili and so on. We look forward to your efforts to help more projects and welcome you to participate in the community work of BRPC to build a world-class RPC framework. If you are interested, you can contact Lorinll at [email protected] or at WeChat. In addition, welcome to join Bytedance infrastructure, which has the industry’s leading distributed storage/computing technology, large scale application scenarios, interested students can also contact me on WeChat or email.
ApacheCon Asia full agenda address: https://www.apachecon.com/aca…
Immediately registered address: https://hopin.com/events/apac…