ApacheKafka is a distributed stream processing platform. It has the following characteristics: high throughput, single Broker can easily handle thousands of partitions and millions of...
Kafka is suitable for both offline and online message consumption, with messages stored on disk. Kafka generalizes messages on a Topic basis. Producers send (Push)...
All descriptions of Kafka primitives in this article are based on Kafka version 1.0.0 unless otherwise noted. The Kafka transaction mechanism is implemented primarily to...
In this article, I'll start with the physical way messages are stored in Kafka and introduce the layers of partition-journal-logging. And then I'm going to...
Each partition is a sequential, immutable message queue that can be continuously added. The messages in the partition are assigned a sequence number called offset,...
Apache Kafka is a distributed publish-subscribe messaging system. It is the only king of message queue in the field of big data. Originally developed by...
Before we talk about Kafka's transactions, let's talk about the implementation of idempotent in Kafka. Idempotent and transaction are two features introduced in Kafka 0.11.0.0...
Kafka message stacking ability is strong, can pile up hundreds of millions of messages, especially suitable for log processing such real-time requirements are not too...
This article mainly describes how to use Docker to build Kafka standalone version and cluster version, and some answers to the problems encountered, hoping to...
Kafka uses Zookeeper to maintain information about the brokers. Each broker has a unique identity broker.ID that identifies it within the cluster, which can be...
Publish and subscribe to streams of records, similar to a message queue or enterprise messaging system. Publish and subscribe data flows, much like message queues...
The open source community has many excellent queue middleware, such as RabbitMQ and Kafka, and each queue seems to have its own characteristics, which can...
Abstract: message queue Kafka is a distributed, high throughput, high extensibility, message queue service, widely used in log collection, monitoring, data aggregation, streaming data processing,...
To ensure high availability of the cluster, the Zookeeper cluster should have an odd number of nodes and at least three nodes. Therefore, a three-node...