Kafka Producer buffer pool mechanism
Kafka Producer blocks sending messages asynchronously? After reading the source code again, I found that the buffer pool design is very good, and its design...
Read More
Tag: kafka
Kafka from the Beginning to the Real World
February 6, 2024
by 楊俊宏
No Comments
1. What is kafka? Kafka is a distributed publish-subscribe messaging system. Originally developed by LinkedIn and later part of the Apache project, Kafka is a...
Read More
Visualization allows you to quickly manage kafka ACL configurations
February 6, 2024
by Kaitlyn Bowden-Larsen
No Comments
Kafka ACL management in the new user or permission management by command is cumbersome, is there a visual management platform for easy management?
Read More
Kafka uses SCRAM authentication to quickly configure and enable ACLs
February 6, 2024
by Taimur Chandra
No Comments
Kafka supports two authentication mechanisms based on SSL and SASL. SASL is used in this article. Kafka supports five SASL mechanisms: GSSAPI, PLAIN, SCRAM, OAUTHBEARER,...
Read More
Kafka cluster construction and use with Springboot
February 6, 2024
by 梁淑慧
No Comments
Because kafka used not much before, only to write and read data in topic, this time just to use, record kafka cluster construction and combined...
Read More
Kafka visual Web management tool
February 6, 2024
by Rachel Simpson
No Comments
As anyone who has used Kafka knows, there is no admin interface for Kafka itself, and all operations must be performed manually. But some of...
Read More
Kafka kafka
February 6, 2024
by Carly Phillips
No Comments
We all know that Kafka is a distributed streaming platform. It is widely used in the field of big data. And what features can it...
Read More
How can Kafka data be guaranteed against loss?
February 6, 2024
by Russell Bibi-Burke
No Comments
This article gives an overview of how Kafka ensures that message queues are highly available, how Kafka ensures that data is not lost, and explains...
Read More
How does Kafka guarantee order
February 6, 2024
by Michael Hart
No Comments
Messages to each partition in Kafka are written in order, and a single partition can only be consumed by a single consumer, thereby ensuring that...
Read More
Python Kafka producers frequently lose data.
February 6, 2024
by Frances Jones
No Comments
Python Kafka producer sends data frequently missing data? Messages Lost By producers After producers invoke the send method to send messages, the messages may not...
Read More
Where does Kafka have the concept of partition allocation? Describe the general process and principles
February 6, 2024
by 李冠宇
No Comments
Partition allocation is an important concept in Kafka, which affects the overall performance balance of Kafka. There are three places in Kafka that cover this...
Read More
Kafka Basic Architecture and Principles (Learning Points)
February 6, 2024
by Anne Anderson
No Comments
It persists messages to disk and can therefore be used for bulk consumption, such as ETL, as well as real-time applications. As shown above, a...
Read More
Kafka file storage mechanism
February 6, 2024
by Pam Clark
No Comments
Kafka messages are classified by topics. Producers send messages to Kafka brokers through topics, and consumers read data through topics. Topic can also start with...
Read More
Kafka producer partitioning policy
February 6, 2024
by Brett Flynn
No Comments
Foreword looked up some information and saw a lot of online articles, always feel that Kafka producer partition strategy to explain clearly, this article will...
Read More
Analyze the Kafka Producer message caching model
February 5, 2024
by Robert Morris-Ali
No Comments
When sending a message, can the body of the message be written to the message cache when the Broker fails? Are messages lost if the...
Read More
Introductory article! Kafka in plain English
February 5, 2024
by Angela Shepherd
No Comments
Today we are going to talk about Kafka, mainly to introduce you to Kafka, and talk about some of the important concepts and problems in...
Read More
Kafak Producer message caching model
February 5, 2024
by Millie Forbes-Todd
No Comments
Kafak Producer Message caching model Kafak Producer message caching model Kafak Producer message caching model
Read More
Kafka message loss and TCP management
February 5, 2024
by Mishti Sibal
No Comments
Kafka no message loss configuration Under what circumstances can Kafka be guaranteed not to lose messages? Kafka only makes limited persistence guarantees for committed messages.
Read More
Kafka producer message partitioning and compression algorithm
February 5, 2024
by Kiaan Bir
No Comments
Producer message partitioning. When we use Kafka, we want to distribute data evenly across all servers. In this way, our load balancing becomes perfect.
Read More
Autonomous Kafka cluster based on open source components
February 5, 2024
by James Gonzalez
No Comments
This article describes how Slack builds an automated Kafka infrastructure based on open source tools such as Chef, Terraform, CruiseControl, and CMAK to automate the...
Read More
Kafka Interview rapid-fire, see how far you can go? (on)
February 5, 2024
by Ojas Shan
No Comments
Kafka about the core interview questions in a series, from the "basic knowledge", "advanced promotion", "architecture tuning" three directions to comb the interview questions, I...
Read More
Time wheel algorithm design from Kafka
February 5, 2024
by Miss Sara Welch
No Comments
There are many delayed operations in Kafka. For example, time-consuming network requests (such as waiting for ISR copy to be successfully replicated while producing) are...
Read More
How to deal with Kafka’s rebalance?
February 5, 2024
by Ivana Saha
No Comments
Kafka is our most popular message queue, and we're thrilled with its tens, if not hundreds, of thousands of processing speeds. But as we use...
Read More
Kafka: How to avoid consumer Rebalance
February 5, 2024
by Miraan Lad
No Comments
In our last post we talked about the mechanics of Rebalance, so I'm sure you have a good idea of how to Rebalance your consumer...
Read More
SpringBoot+Kafka+ELK complete massive log collection
February 4, 2024
by Alexis Thompson
No Comments
SpringBoot project is going to introduce log4j2 to replace the default SpringBoot log. The demo project structure is as follows:
Read More
Clickhouse synchronizes data with Kafka
February 4, 2024
by Michael Hart
No Comments
Clickhouse itself is an analytical database that provides many synchronization solutions with other components. In this article, Kafka will be used as a data source...
Read More
[Kafka core principle analysis] tuning strategy analysis
February 4, 2024
by Ehsaan Yohannan
No Comments
When it comes to tuning, monitoring is often necessary. Kafka itself does not provide a good graphical monitoring system, but there are many third-party kafka...
Read More
[Kafka core principle analysis] technical concept and architecture principle
February 4, 2024
by 李懿
No Comments
At present, Kafka has been positioned as a distributed streaming processing platform, which is widely used for high throughput, persistence, horizontal expansion, support for streaming...
Read More
Springboot -kafka consumes data and submits offset
February 4, 2024
by 李俊宏
No Comments
This article summarizes the setup of the listener container when submitting offset when consuming data using Springboot-kafka.
Read More
EFAK – Kafka visual management tool
February 4, 2024
by Susan Day
No Comments
EFAK EFAK (Eagle For Apache Kafka, formerly known as Kafka Eagle) EFAK is open source visualization and management software, which can query, visualize, and monitor...
Read More