Kafka’s architecture
"This is the 15th day of my participation in the November Text Challenge. For details: 2021 Last Text Challenge" Architecture case Kafka Cluster: Consists of...
Read More
Tag: kafka
(5) The consumer principle of Kafka and detailed explanation of its use
January 25, 2024
by Samantha Rice
No Comments
1. One consumer consumes data from a Topic: 2. Consumer group: When the producer writes messages to a Topic at a speed that exceeds the...
Read More
Kafka SpringBoot integration
January 25, 2024
by Brittany Smith
No Comments
SpringBoot kafka 1. Kafka 2 has been installed. Create a SpringBoot project Add project dependencies Add the configuration file application.properties Add the configuration file (optional)...
Read More
Kafka Consumers and Zones (07)
January 25, 2024
by Shelley Chapman-Williams
No Comments
In the publish-subscribe model, a message is broadcast to all consumers and can be processed by any consumer that receives it. Kafka provides a single...
Read More
Use Javassist to modify the bytecode to start eureka-Client listening service
January 25, 2024
by Samar Ramesh
No Comments
Some services in the project need to monitor the startup information of other micro-services, and the master needs to send requests to pull some configurations...
Read More
Kafka cluster + Zookeeper + Kafka-Manager
January 25, 2024
by Sarah Barrett
No Comments
Here we use the simplest way to create a single Zookeeper node. If you want to consider the high availability of Zookeeper, you can make...
Read More
Kafka consumer offset lag increases
January 25, 2024
by Elakshi Tak
No Comments
This article mainly analyzes a kafka consumer offset lag that keeps increasing. See abnormal log at the beginning, to find this, plus the above jstack,...
Read More
The reason revealed! Why Pulsar and not Kafka
January 25, 2024
by Gerald Watkins
No Comments
I think Pulsar is a reasonable alternative to Kafka. Pulsar supports most of Kafka's features, and Pulsar has more advantages (I've listed 12 so far).
Read More
Apache Pulsar vs. Kafka performance: Latency (Test Process)
January 25, 2024
by Patricia Nolan
No Comments
This series of articles will focus on Pulsar and Kafka's latencies, followed by articles on throughput. This article covers the test details, the next article...
Read More
More detailed of actual combat | Kafka cluster operations
January 25, 2024
by 欒俊傑
No Comments
"This is the 10th day of my participation in the November Gwen Challenge. See details of the event: The Last Gwen Challenge 2021". Create a...
Read More
A look at the new features in KoP 2.8.0
January 24, 2024
by 劉懿
No Comments
At a tGIP-CN live event on April 11, StreamNative engineer 徐昀泽 shared a preview of the new KoP 2.8.0 features. This article is a condensed...
Read More
Su Ning’s practice of real-time log analysis system based on Spark Streaming
January 24, 2024
by 李冠宇
No Comments
At present, the underlying computing platform based on Hadoop technology stack is more stable and mature, and computing capacity is no longer the main bottleneck....
Read More
Kafka source code analysis 18- How to handle a message that has not received a response for a long time
January 24, 2024
by David Gonzalez
No Comments
Let's look directly at NetworkClient's poll() method: Let's look at handling timeout requests handleTimedOutRequests(Responses, updatedNow) that is, quests that have not been received for a...
Read More
Spark Streaming + Kafka programming practice based on Python
January 23, 2024
by Jason Dillon
No Comments
There are many articles explaining the principle of Spark Streaming, which will not be covered here. This article mainly introduces the programming model using Kafka...
Read More
Simple use of the Kafka producer and consumer API
January 23, 2024
by Janet Bird
No Comments
Here's a quick note, using the Kafka API to send and receive messages. KafkaProducer is thread-safe and can be used in multiple threads. The main...
Read More
Flume+Kafka+Storm+Redis builds a real-time processing system for big data
January 23, 2024
by Billy Turner
No Comments
The previous article is an offline data analysis case based on MapReduce, which processes the user access logs generated by the website and analyzes the...
Read More
Discussion of Kafka log retention strategies
January 23, 2024
by Tony Robinson
No Comments
There are many articles on the web about Kafka's log retention strategy. However, there have been some changes in the strategy, so this article for...
Read More
Distributed messaging system: Kafka
January 23, 2024
by Brett Davies
No Comments
Kafka is a distributed publish-subscribe messaging system. It was originally developed by LinkedIn and later became part of the Apache project. Kafka is a distributed,...
Read More
Spark Streaming: Basic working principle
January 23, 2024
by Armaan Brahmbhatt
No Comments
Spark Streaming is an extension of the Spark Core API that can be used for large-scale, high-throughput, fault-tolerant real-time data Streaming. It supports reading data...
Read More
Full of dry goods, Tencent Cloud + community technology salon Kafka Meetup shenzhen station successfully concluded
January 23, 2024
by Donna Morgan
No Comments
Cloud + Introduction: On April 22, The Tencent Cloud + Community technology salon Kafka Meetup shenzhen station hosted by Tencent Cloud and Kafka community and...
Read More
Kafka is a solution to sticky unpacking.
January 22, 2024
by Ms. Elizabeth Butler
No Comments
Kafka version: 0.9.0 in front of the author wrote an article on the clean sticky packet unpacking comprehensive explain TCP sticky packet unpacking related problems....
Read More
Where did the names Hadoop and Zookeeper come from?
January 22, 2024
by 張飛
No Comments
First of all, Apache is an HTTP server, and the familiar Apache in Hadoop refers to the Apache Software Foundation. Apache is a project of...
Read More
If you don’t know what to do, learn a miscellaneous subject
January 22, 2024
by 周琬婷
No Comments
This article has no code, please feel free to read. Years later, faced with the chaotic code of the AI researcher, I would recall that...
Read More
SpringBoot integrates Kafka and installs kafka under Windows
January 22, 2024
by 喬彥廷
No Comments
Java: ErrorCode messageentity.ja
Read More
SpringBoot Kafka integrated use
January 21, 2024
by Sheila Davis
No Comments
Assume you know SpringBoot and Kafka. If you don't know SpringBoot, check out the DD bigwig and the Pure Smile series of blogs. Kafka Kafka...
Read More
What does Kafka do if it loses a message?
January 21, 2024
by Callum Hussain
No Comments
Kafka suffers from message loss. Message loss occurs between brokers, producers, and consumers. Brokerbrokers lose messages due to Kafka itself, Kafka for better performance and...
Read More
Producer Interceptor (II)
January 21, 2024
by Matthew Hill
No Comments
Similar we write a blocker ProducerInterceptorAnalysis2 again. The purpose of both interceptors is to prefix them before sending, obviously in order A > B and...
Read More
Kafka today to the company partner training introduction, understand?
January 21, 2024
by Kaia Cole-Brown
No Comments
Middleware is a type of computer software that connects software components to applications and includes a set of services. To make it easier for multiple...
Read More
Multithreaded read Kafka encountered problems and solutions
January 21, 2024
by Navya Sastry
No Comments
* * * * * * * * * * * * * * * * * * * * * * * * *...
Read More
Springboot integrates native Kafka
January 21, 2024
by 劉怡安
No Comments
No nonsense, pure dry goods, SpringBoot integrated Kafka tutorial. The first is the local kafka installation and running, and then springBoot on kafka configuration, including...
Read More