How does Go manipulate Kafka to guarantee no message loss
At present, some Internet companies will use message queues to do core business, because it is the core business, so the final consistency of data...
Read More
Tag: kafka
How does Kafka monitor multiple consumers consuming the same Topic?
January 4, 2024
by 朱惠婷
No Comments
Hw_data has 3 partitions and 3 replica groups: hw-data-group distributes the message of this Topic to two (or more) consumers for consumption.
Read More
(8) Reliability guarantee of Kafka message
January 4, 2024
by Kevin Mendoza
No Comments
1. Multi-copy data synchronization Policy To improve message reliability, Kafka has N copies for each partition. Among the N replicas, one replica is the Leader...
Read More
Don’t understand Kafka rebalancing? Take a look at this.
January 4, 2024
by Aaron Middlemiss
No Comments
In Kafka, a topic pair should have multiple partitions, and each partition must be consumed by only one consumer from the same consumer group. To...
Read More
Save json data as an S3 Parquet file
January 4, 2024
by 周佳樺
No Comments
In our work, we need to use Kafka Connect to transfer json data from Kafka to S3 and save it as Parquet.
Read More
Kafka Avro serialization and S3 Parquet Sink
January 4, 2024
by 王怡萱
No Comments
Kafka producer/consumer/connect using Avro serialization methods, and use the connect to save data to the S3, save format for Parquet file
Read More
Talk about Kafka: Build Kafka on Linux
January 3, 2024
by 崔惠如
No Comments
Zookeeper 3.4.14 zookeeper 3dCH kafka kafka2.12 kafka2.12
Read More
Kafka Basics: Why speed is Fast
January 3, 2024
by Rhea Sachar
No Comments
Why does Kafka have a fast sequential READ/write speed? Why does a disk have a fast sequential read/write speed? Internal components zero copy mmap PageCache...
Read More
Why is Kafka so fast?
January 3, 2024
by 遊信宏
No Comments
Kafka is a high-throughput distributed messaging system developed by LinkedIn (LNKD). Kafka is basically a publish and subscribe message queue. Application scenarios Kafka can be...
Read More
Kafka: Why is Kafka so fast?
January 3, 2024
by Lisa Quinn
No Comments
We all know that Kafka is based on disk storage, but Kafka officially claims that it has high performance, high throughput, low latency characteristics, its...
Read More
Interviewer: Tell me how Kafka processes requests
January 3, 2024
by George Kerr-Allen
No Comments
Hello, I'm Yes. Today, I will talk about the whole process of Kafka Broker, analyze how the underlying network communication is implemented, Reactor's application on...
Read More
Introduction to Kafka (3) : How do Sarama producers work
January 3, 2024
by Kevin Rodriguez
No Comments
In this article, I will start with how Sarama's synchronous and asynchronous producers are created, and then I will show you what the parameters in...
Read More
Kafka Technology Core Notes (5) Basic Use (3)
January 2, 2024
by Martyn Henry
No Comments
A Consumer Group can have one or more Consumer instances. The instance here can be a single process or a thread under the same process....
Read More
Kafka producer send “一”
January 2, 2024
by Badal Kashyap
No Comments
I started to learn Kafka very early, and I have read some server-side source code intermittently. I have heard rumors about his log design, but...
Read More
Kafka Series transaction Producers (12)
January 2, 2024
by 劉鈺婷
No Comments
Kafka has also provided support for transactions since version 0.11, and currently primarily does things at the Read Committed isolation level. It ensures that multiple...
Read More
After running performance tests on Kafka and Pulsar, Lakala switched to Pulsar as a unified messaging platform
January 2, 2024
by Frank Green
No Comments
Lakala Payment, founded in 2005, is a leading third-party payment company in China. It is committed to integrating information technology, serving offline entities, and enabling...
Read More
Kafka SpringBoot integration
January 2, 2024
by Dana Mullen
No Comments
Messages: Units of data in Kafka are called messages, also known as records, and can be thought of as records for a row in a...
Read More
Kafka SpringBoot integration
January 2, 2024
by Lakshay Bala
No Comments
Here's a quick note on SpringBoot and Kafka integration. | - manual_immediate: said manual submitted, when calling Acknowledgment# acknowledge immediately after submission. 1. Send the...
Read More
Kafka message object ProducerRecord
January 2, 2024
by Dr. Gregory Hughes
No Comments
The ProducerRecord introduction Topic and partition fields represent the topic and partition number to which the message is sent, respectively. The Headers field is the...
Read More
Kafka Producer Interceptor (06)
January 2, 2024
by 徐建宏
No Comments
The interceptor is a fairly new feature. It was introduced in The 0.10 version of Kafka and is mainly used to implement custom control logic...
Read More
Idempotent Producer kafka Series (11)
January 2, 2024
by Charles Ellis
No Comments
In imperative programming languages such as C, if a subroutine is idempotent, it must not modify system state. This way, no matter how many times...
Read More
Kafka producer instance configuration parameters
January 2, 2024
by Dana Robertson
No Comments
Bootstrap. servers: Specifies the list of broker addresses required by producer clients to connect to the Kafka cluster, in the format of host1:port1,host2:port
Read More
Kafka Configuration 4– Configure the SSL certificate for Kafka on Windows
January 2, 2024
by Fiona Lewis
No Comments
Kafka configuration 1--Windows installation and configuration Kafka Kafka configuration 2--Windows configuration Kafka sasl-plain authentication Kafka configuration 3--Windows configuration Kafka cluster
Read More
Windows10 Kafka Docker cluster construction
January 2, 2024
by Saira Mahal
No Comments
Create copies of 3 and partitions of 5 to check whether the configuration is successful. Then launch the consumer, 0 production message on 1 and...
Read More
Kafka Configuration 1– Install and configure Kafka for Windows
January 2, 2024
by 丁怡安
No Comments
Kafka configuration 1--Windows installation and configuration Kafka Kafka configuration 2--Windows configuration Kafka sasl-plain authentication Kafka configuration 3--Windows configuration Kafka cluster
Read More
What is the overall structure of the Kafka producer client?
January 2, 2024
by Katie Washington
No Comments
A normal producer logic requires the following steps: Configure producer client parameters and create the corresponding producer instance. Construct the message to be sent
Read More
Kafka cluster setup procedure and common commands
January 2, 2024
by Victoria Parker
No Comments
1, Kafka installation requires Java environment, Cent OS 7 comes with Java1.6 version, you can do not need to reinstall, directly use the JDK can;...
Read More
Kafka configuration 3– Configure the Kafka cluster under Windows
January 2, 2024
by 張心怡
No Comments
Kafka configuration 1--Windows installation and configuration Kafka Kafka configuration 2--Windows configuration Kafka sasl-plain authentication Kafka configuration 3--Windows configuration Kafka cluster
Read More
Deep understanding of the server side of Kafka
January 2, 2024
by Dominic Carr
No Comments
Protocol Design Kafka defines a set of binary protocols based on TCP. You can send messages to Kafka as long as the protocol format is...
Read More
Kafka producer client development
January 2, 2024
by Charles Cervantes
No Comments
Maven a normal production logic requires the following steps: Configure producer client parameters and create producer instances. Build messages to be sent. Send messages to...
Read More