Tag: kafka

The back-end

Build docker-based Kafka cluster and Spring Boot application access

December 22, 2023

by Jonathan Richards

No Comments

Docker-compose: docker-compose does not specify the kafka container name and does not expose kafka-related ports, which is convenient for docker-compose to scale the container. Creating...

Read More

The back-end

Kafka producer ACK mechanism analysis

December 22, 2023

by Dana Robertson

No Comments

Kafka has two important configuration parameters, acks and min.insync.replicas. Acks are the configuration parameters of producer, and min.insync.replicas are the configuration parameters of Broker

Read More

Artificial intelligence (ai)

Kafka: Guarantees that messages are not lost or repeated

December 22, 2023

by Dhanush Kota

No Comments

Preface This is an article of the dump, and my summary is at the beginning, and I hope you can point out in the comments...

Read More

The back-end

Understand the Kafka consumer group from the actual combat

December 22, 2023

by Katherine Jones

No Comments

Kafka as a beginner, need to grow up quickly, assume the responsibility of maintaining the company Kafka, Kafka learning, I follow the three step strategy:...

Read More

The back-end

Kafka principle explained in detail

December 22, 2023

by 熊雅涵

No Comments

Boring weekend brush mobile phone, a Taobao APP suddenly jumped out a message "in order to reward old customers, girlfriend buy one get one free,...

Read More

The back-end

Message-oriented middleware architecture – Kafka: From “getting started” to “advanced”, it’s not too hard!

December 22, 2023

by Badal Loyal

No Comments

Kafka is a distributed message publishing and subscription system with high performance and high throughput, which is widely used in big data transmission scenarios. It...

Read More

The back-end

Learning Kafka | Theory-2 | Brokers

December 22, 2023

by Divyansh Swaminathan

No Comments

This article attempts to introduce the concept of Kafka Broker. Each Broker has an identity-Broker ID. Topics can be divided into partitions and stored in...

Read More

The back-end

What do ISR and AR stand for in Kafka? What is scaling of ISR? /unclean.leader.election

December 22, 2023

by Natalie Gonzalez

No Comments

SR and AR In simple terms, all Replicas in a partition are called AR (Assigned Replicas). All replicas (including the leader replicas) that maintain some...

Read More

The back-end

Kafka – Design principles illustrated

December 22, 2023

by Juan Young

No Comments

Kafka is a mainstream message flow system, one of the concepts or more, the following through the graphical way to comb Kafka's core concepts, in...

Read More

The back-end

Kafka installation configuration cheat sheet

December 22, 2023

by Anthony Gifford

No Comments

One. Installation two. Configuration 3: Start

Read More

The back-end

Kafka Producer single-partition sequence implementation and configuration

December 22, 2023

by Rebecca Short

No Comments

Today, the last part of Kafka Producer is described. Most of the content of Producer has been introduced in the previous several articles. Here is...

Read More

The back-end

Message queue – Kafka consumption exception issue

December 22, 2023

by Guy Jones-James

No Comments

Overview In Kafka, or in any message queue, there is a consumption order problem. In order to ensure the sequential consumption of a queue, when...

Read More

The back-end

Consumer implementation logic – Kafka Body of Knowledge 4

December 22, 2023

by Dr. Nathan Matthews

No Comments

In the last article, WE discussed the implementation of Kafka Broker, the storage structure of data, and the persistence of messages. After a message is...

Read More

The back-end

Message queue – Kafka message loss problem

December 21, 2023

by Kevin Smith

No Comments

Message queue missing message is a classic problem, but also we are easy to ignore in the development of the problem, the most important is...

Read More

Artificial intelligence (ai)

Kafka source code parsing: Server side running process

December 21, 2023

by Beth Robinson

No Comments

Abstract: Kafka network module Server, introduces the Server start, receive requests and processing requests process. This article is shared by Huawei cloud community "Kafka network...

Read More

The back-end

Kafka No-loss configuration (4)

December 21, 2023

by Anna Wolfe

No Comments

Under what circumstances can Kafka ensure that messages are not lost? In a nutshell, Kafka only makes limited persistence guarantees for committed messages. There are...

Read More

The back-end

Kafka HW backup mechanism

December 21, 2023

by Margaret Torres DVM

No Comments

This is the seventh day of the kafka High availability Challenge. We will start with a section on the basic principles of kafka high availability....

Read More

The back-end

✈️ Kafka installation and log storage structure

December 21, 2023

by Dhanuk Guha

No Comments

Kafka install Kafka install Kafka view configuration file modify configuration file server.properties Set kafka data store path Settings can be deleted t

Read More

The back-end

Kafka2.4 consumer client (PartitionAssignor)

December 21, 2023

by William Turner

No Comments

Preface The last article analyzes the producer client process, this article began to analyze the consumer client process source code, starting from PartitionAssignor analysis, look...

Read More

reading

Apache Kafka-01 – Kafka introduction

December 21, 2023

by Miraya Brahmbhatt

No Comments

For some reason, the first thing that comes to my mind is Chekhov's Man in a Case. I checked it out later, and it turned...

Read More

The back-end

How do Kafka message queues ensure orderliness?

December 21, 2023

by Zachary Taylor

No Comments

Messages with the same key value are written to the same partition (the messages in the partition are ordered). The messages in one partition are...

Read More

The code of life

Kafka: being a Producer

December 21, 2023

by Anvi Garg

No Comments

How to use simple messages to partition code instances

Read More

The back-end

4. Deep dive KafkaProducer — RecordAccumulator

December 20, 2023

by Seth Harvey

No Comments

When a service thread sends a message using kafkaproducer.send (), it will be written into RecordAccumulator for buffer

Read More

The back-end

Kafka Deployment Manual (Linux)

December 20, 2023

by Henry Anderson

No Comments

Download the installation package. 3. Decompress the package. 6. Create topic 7. WordCountDemo can be tested using the following Demo, you need to change kafka-Broker1...

Read More

The back-end

【 Kafka exception 】 Kafka common exception handling solution (continuously updated! Suggested collection)

December 20, 2023

by Paula Eglinton

No Comments

1. The Leader epoch is out of date, causing an error when follow the fetchleader. As long as the Leader election happens again

Read More

The back-end

O&m of Logi-Kafkamanger (4) — Cluster O&M (Data Migration and Cluster Online Upgrade)

December 20, 2023

by Neil Evans

No Comments

This is the 16th day of my participation in the August More text Challenge. For details, see: August more text Challenge technical communication. For those...

Read More

The back-end

How does Kafka ensure data consistency across replicas

December 20, 2023

by 張詩涵

No Comments

A copy is a copy of a particular partition. A partition contains multiple copies distributed among different brokers. One of the copies is the leader...

Read More

reading

Technology Evolution and Practice of Qunar Data Synchronization Platform

December 20, 2023

by Keith Mason

No Comments

In this paper, we will discuss with you the design and practice of multi-version migration support of data synchronization platform ES, high availability of data...

Read More

reading

Data synchronization system reconstruction practices

December 20, 2023

by Miraan Lad

No Comments

What a data synchronization system does is to import data from one data source to another, provide homogeneous or heterogeneous data synchronization with low latency,...

Read More

The back-end

Install and use kafka commands

December 20, 2023

by Angela McKay

No Comments

Kafka relies on ZooKeeper. Install the ZooKeeper cluster before installing the Kafka cluster. Installation Example Three machines: node01, NODE02, and node03 ZooKeeper set

Read More