About the Apache Pulsar
Apache Pulsar is a top-level project of Apache Software Foundation. It is a next-generation cloud-native distributed message flow platform that integrates messaging, storage, and lightweight functional computing. It is designed with a computing and storage separation architecture, and supports multi-tenant, persistent storage, and cross-region data replication in multiple rooms. It provides streaming data storage features such as strong consistency, high throughput, low latency, and high scalability.
GitHub: github.com/apache/puls…
Introduction:
Ladies and gentlemen, the Pulsar community weekly update is coming!
This Pulsar weekly will provide you with information about Pulsar clients, brokers, transactions and so on. It will help you understand the progress of Pulsar projects and the weekly progress of Pulsar. It will also help you to better participate in the Pulsar community.
Thanks to the following people who contributed to Apache Pulsar this week (in no particular order, see if you made the list) :
Lhotari, Kaushik-Develop, BewareMyPower, RobertIndie, Gaoran10, Eolivelli, Technoboy-, Codelipenghui, Nlu90, Jerrypeng, 315157973, Shoothzj, Equanz, Freeznet, Horizonzy, Wangjialing218, rdhabalia, Demogorgon314, Urfreespace, Anonymitaet, zymap, rfigueroa
Here’s a look at what’s going on between July 19 and July 25.
This week’s highlights
[Broker] PIP-82: Updates resource group statistics. Github.com/apache/puls… Contributor: Kaushik-Develop
C++ Client: supports Protobuf native schema. Github.com/apache/puls… Contributor: BewareMyPower
Important features
• Due to the large number of PR, only the large PR progress is listed, not including all the dynamics of the week • The following PR have been added to the main branch of Pulsar
Broker: Supports multiple roles for authorization. Github.com/apache/puls… Contributor: RobertIndie
Python Client: Supports complex schemas. Github.com/apache/puls… Contributor: Gaoran10
Pulsar IO: Allows the Pulsar IO Sink Connector to use native AVRO and JSON formats. Github.com/apache/puls… Contributor: Eolivelli
Monitor: Adds the storageLogicalSize statistical indicator to TopicStats and NamespaceStats. Github.com/apache/puls… Contributor: Technoboy-
Broker: Disable the Replicator and Replication clients when deleting the Pulsar cluster. Github.com/apache/puls… Contributor: Codelipenghui
Important Bug fixes
• The following fixes have been added to the main branch of Pulsar
CLI: Fixed a problem with the Pulsar -admin CLI tool when verifying batch source configurations. Github.com/apache/puls… Contributor: Jerrypeng
Admin: Fixed an issue where only subscriptions created for partition-0 were listed when creating subscriptions for a specific Partition. Github.com/apache/puls… Contributor: Technoboy-
Function: Reduces the probability of cache inconsistency. Github.com/apache/puls… Contributor: 315157973
Trnasaction: Fix direct memory leaks related to commit and abort flags. Github.com/apache/puls… Contributor: Lhotari
Client: Avoid infinite wait while consumer is closed. Github.com/apache/puls… Contributor: Shoothzj
Broker: Deletes the topic-level policy after deleting the topic. Github.com/apache/puls… Contributor: Horizonzy
Python Function: Fixed an issue where Python Functions do not support TLS_VALIDATE_hostname when running. Github.com/apache/puls… Contributor: Freeznet
C++ Client: use the same regular expression code in ZTSClient. Github.com/apache/puls… Contributor: Equanz
Broker: Fixed an issue where Broker leaks direct memory when using replication subscriptions and Key_Shared Consumer. Github.com/apache/puls… Contributor: Lhotari
Broker: Fixes Npes that occur when the built-in connector does not exist. Github.com/apache/puls… Contributor: Jerrypeng
The surrounding ecological
Connector: Supports multiple Elasticsearch hosts. Github.com/apache/puls… Contributor: Wangjialing218
Pulsar IO: ensure AbstractKafkaSourceRecord ack no obstruction () method to avoid deadlock. Github.com/apache/puls… Contributor: NLU90
NiFi: Fixed concurrency issues in NarUnpacker. Github.com/apache/puls… Contributor: Lhotari
Events and News
• register Pulsar Virtual Summit Europe 2021[1]•[英文 community] TGIP: Pulsar and its ecosystem [2]•[英文 community] tgip-cn: Pulsar and its ecosystem [3]
Post to recommend
Pulsar, Apache milestone history: create a unified message flow platform and ecology, the full version | 2021 Apache Pulsar user survey report, video review | Pulsar Summit 2021 north American Summit – user special case presentation
As a global open source project, As of July 25, 2021, Apache Pulsar has 430 contributors, 9.4K + Star, and 2.3K + Fork. The Apache Pulsar project continues to grow and move forward thanks to the contributions of the community of developers around the world.
Look forward to next week’s Apache Pulsar weekly!
If you want to be a Contributor to the Apache Pulsar project, see the link below to join us:
Apache Pulsar Official Contribution Guide [4]
reading
• Pulsar Community Weekly | 2021-07-12 ~ 2021-07-18• Pulsar Community Weekly | 2021-07-05 ~ 2021-07-11• Pulsar Community Weekly | 2021-06-28 ~ 2021-07-04\
Reference links
[1] Pulsar Virtual Summit Europe 2021: hopin.com/events/puls… [2] TGIP: Pulsar and its ecosystem: Streamnative. IO/Resource# TG… [3] TGIP – CN: Pulsar, and its ecological system: www.slidestalk.com/ApachePulsa… [4] Apache Pulsar official contributions guidelines: pulsar.apache.org/en/contribu…