About the Apache Pulsar

Apache Pulsar is a top-level project of Apache Software Foundation. It is a next-generation cloud-native distributed message flow platform that integrates messaging, storage, and lightweight functional computing. It is designed with a computing and storage separation architecture, and supports multi-tenant, persistent storage, and cross-region data replication in multiple rooms. It provides streaming data storage features such as strong consistency, high throughput, low latency, and high scalability.

GitHub: github.com/apache/puls…

Introduction:

Ladies and gentlemen, the Pulsar community weekly update is coming!

This Pulsar weekly will provide you with information about Pulsar clients, brokers, transactions and so on. It will help you understand the progress of Pulsar projects and the weekly progress of Pulsar. It will also help you to better participate in the Pulsar community.

Thanks to the following people who contributed to Apache Pulsar this week (in no particular order, see if you made the list) :

Lhotari, Kaushik-Develop, BewareMyPower, RobertIndie, Gaoran10, Eolivelli, Technoboy-, Codelipenghui, Nlu90, Jerrypeng, 315157973, Shoothzj, Equanz, Freeznet, Horizonzy, Wangjialing218, rdhabalia, Demogorgon314, Urfreespace, Anonymitaet, zymap, rfigueroa

Here’s a look at what’s going on between July 19 and July 25.

This week’s highlights

[Broker] PIP-82: Updates resource group statistics. Github.com/apache/puls… Contributor: Kaushik-Develop

C++ Client: supports Protobuf native schema. Github.com/apache/puls… Contributor: BewareMyPower

Important features

• Due to the large number of PR, only the large PR progress is listed, not including all the dynamics of the week • The following PR have been added to the main branch of Pulsar

Broker: Supports multiple roles for authorization. Github.com/apache/puls… Contributor: RobertIndie

Python Client: Supports complex schemas. Github.com/apache/puls… Contributor: Gaoran10

Pulsar IO: Allows the Pulsar IO Sink Connector to use native AVRO and JSON formats. Github.com/apache/puls… Contributor: Eolivelli

Monitor: Adds the storageLogicalSize statistical indicator to TopicStats and NamespaceStats. Github.com/apache/puls… Contributor: Technoboy-

Broker: Disable the Replicator and Replication clients when deleting the Pulsar cluster. Github.com/apache/puls… Contributor: Codelipenghui

Important Bug fixes

• The following fixes have been added to the main branch of Pulsar

CLI: Fixed a problem with the Pulsar -admin CLI tool when verifying batch source configurations. Github.com/apache/puls… Contributor: Jerrypeng

Admin: Fixed an issue where only subscriptions created for partition-0 were listed when creating subscriptions for a specific Partition. Github.com/apache/puls… Contributor: Technoboy-

Function: Reduces the probability of cache inconsistency. Github.com/apache/puls… Contributor: 315157973

Trnasaction: Fix direct memory leaks related to commit and abort flags. Github.com/apache/puls… Contributor: Lhotari

Client: Avoid infinite wait while consumer is closed. Github.com/apache/puls… Contributor: Shoothzj

Broker: Deletes the topic-level policy after deleting the topic. Github.com/apache/puls… Contributor: Horizonzy

Python Function: Fixed an issue where Python Functions do not support TLS_VALIDATE_hostname when running. Github.com/apache/puls… Contributor: Freeznet

C++ Client: use the same regular expression code in ZTSClient. Github.com/apache/puls… Contributor: Equanz

Broker: Fixed an issue where Broker leaks direct memory when using replication subscriptions and Key_Shared Consumer. Github.com/apache/puls… Contributor: Lhotari

Broker: Fixes Npes that occur when the built-in connector does not exist. Github.com/apache/puls… Contributor: Jerrypeng

The surrounding ecological

Connector: Supports multiple Elasticsearch hosts. Github.com/apache/puls… Contributor: Wangjialing218

Pulsar IO: ensure AbstractKafkaSourceRecord ack no obstruction () method to avoid deadlock. Github.com/apache/puls… Contributor: NLU90

NiFi: Fixed concurrency issues in NarUnpacker. Github.com/apache/puls… Contributor: Lhotari

Events and News

• register Pulsar Virtual Summit Europe 2021[1]•[英文 community] TGIP: Pulsar and its ecosystem [2]•[英文 community] tgip-cn: Pulsar and its ecosystem [3]

Post to recommend

Pulsar, Apache milestone history: create a unified message flow platform and ecology, the full version | 2021 Apache Pulsar user survey report, video review | Pulsar Summit 2021 north American Summit – user special case presentation

As a global open source project, As of July 25, 2021, Apache Pulsar has 430 contributors, 9.4K + Star, and 2.3K + Fork. The Apache Pulsar project continues to grow and move forward thanks to the contributions of the community of developers around the world.

Look forward to next week’s Apache Pulsar weekly!

If you want to be a Contributor to the Apache Pulsar project, see the link below to join us:

Apache Pulsar Official Contribution Guide [4]

reading

• Pulsar Community Weekly | 2021-07-12 ~ 2021-07-18• Pulsar Community Weekly | 2021-07-05 ~ 2021-07-11• Pulsar Community Weekly | 2021-06-28 ~ 2021-07-04\

Reference links

[1] Pulsar Virtual Summit Europe 2021: hopin.com/events/puls… [2] TGIP: Pulsar and its ecosystem: Streamnative. IO/Resource# TG… [3] TGIP – CN: Pulsar, and its ecological system: www.slidestalk.com/ApachePulsa… [4] Apache Pulsar official contributions guidelines: pulsar.apache.org/en/contribu…