Tag: kafka

The back-end

Kafka message service platform implementation

January 18, 2024

by Christopher Decker

No Comments

RELEASE: Spring-integration-kafka 2. Configure the Zookeeper and Kafka distributed cluster using init.properties. 3. Using spring-context-producer configuration schemes...

Read More

The back-end

Kafka high performance system design

January 18, 2024

by Keith Lopez

No Comments

Yes, the first thing you should know is that Kafka messages are stored on file systems. Kafka relies heavily on file systems to store and...

Read More

The back-end

A Kafka pothole filled the road

January 18, 2024

by Joshua Robinson

No Comments

Preface Small knowledge, big challenge! This article is participating in the creation activity of "Essential Tips for Programmers". This article has participated in the "Digitalstar...

Read More

The back-end

Enhancer application access Kafka

January 18, 2024

by Abigail Ford-Little

No Comments

Kafka is a distributed event streaming platform. Producers publish events to Kafka, and consumers subscribe to those events. How do I access Kafka using a...

Read More

The back-end

This is the most detailed Kafka tutorial yet

January 18, 2024

by Sahil Sant

No Comments

In addition to message-oriented middleware, kafka was designed as a system capable of storing data, much like common non-relational databases such as NoSql. Kafka also...

Read More

The back-end

Kafka’s heart — the controller

January 18, 2024

by Chirag Chaudhari

No Comments

1. What is a Controller? A Controller is the core component of Apache Kafka. Its main role is to manage and coordinate the entire Kafka...

Read More

The back-end

Get to know Kafka for the first time and build quickly

January 17, 2024

by Fateh Sandhu

No Comments

Download the TGZ package from the official website, upload it to the server and decompress it. The download address is kafka_2.12-2.1.0.tgz. Kafka uses ZooKeeper to...

Read More

reading

VoltDB enables Kafka to enable real-time business decisions driven by complex data streams

January 17, 2024

by Aaron Cox

No Comments

VoltDB is a high-speed decision engine that provides infrastructure support for applications that must respond in milliseconds, in scenarios such as BSS (Policy and charge),...

Read More

reading

Big Data: How does Kafka deliver millions of messages a second

January 17, 2024

by Saira Mahal

No Comments

The first thing that stands out about Kafka is that it's fast, and it's crazy fast. According to the latest data, Kafka processes more than...

Read More

The back-end

Kafka becomes God’s Way – Index type

January 17, 2024

by 袁俊傑

No Comments

Timeindex file, that is, the timestamp index file. Used to quickly find the file location of the message based on the displacement value. Whenever a...

Read More

The back-end

OffsetOutOfRangeException SparkStreaming read Kafka

January 17, 2024

by 黃怡安

No Comments

Recently, the Spark stream calculation program running in the project suddenly stopped by error and failed to restart due to other reasons. As a result,...

Read More

The back-end

🧅 [Simplicity] Message queues, starting with Kafka

January 17, 2024

by Kaia Cole-Brown

No Comments

Take a quick look at message queues. A message queue is a container that holds messages during their transmission. This includes producers, consumers, queues, and...

Read More

The back-end

Design and implementation of search framework based on Java, Kafka, ElasticSearch

January 17, 2024

by Barbara Thomas

No Comments

Jkes is a search framework based on Java, Kafka, ElasticSearch. Jkes provides annotation-driven JPA-style object/document mapping using REST apis for document searching.

Read More

The back-end

Kafka design principles (1)

January 17, 2024

by Alyssa Mendoza

No Comments

Small knowledge, big challenge! This article is participating in the creation activity of "Essential Tips for Programmers". Kafka is a distributed streaming platform, high throughput...

Read More

The back-end

TOP100summit: [Sharing record -Microsoft] Real-time big data quality monitoring platform based on Kafka and Spark

January 17, 2024

by Luke Robinson

No Comments

This article is based on a case study by xing guodong, senior product manager at Microsoft, in the 2016 TOP100summit. Tony Xing: Senior product manager...

Read More

reading

Kafka vs RabbitMQ

January 17, 2024

by Jose Martinez

No Comments

KafkaSmartconsumer,DumbbrokerPullbasedPartitionforloadbalanceConsumergroupMessageRetentionRabbitMQDu

Read More

The back-end

Redis5.0 features Stream

January 16, 2024

by Lavanya Hans

No Comments

Redis5.0 was suddenly released by the author recently, adding many new features. The biggest new feature of Redis5.0 is the addition of a Stream data...

Read More

reading

Use of Kafka serialization and deserialization

January 16, 2024

by Nitara Biswas

No Comments

Use read serialization files and deserialization as required by the project. We're just using consumers here. As described in the original document, you can see...

Read More

reading

Docker-based log analysis platform (iii) Quick start

January 16, 2024

by Carol Baker

No Comments

2.KafkaKafka is a distributed streaming platform developed by Linked and open source. It is similar to a message queue. Kafka's

Read More

reading

Big Data Interview Questions and Answers (1)

January 16, 2024

by Anne Atkins

No Comments

A Kafka Message consists of a fixed-length header and a variably long body. The header consists of a one-byte magic(file format) and a four-byte CRC32(to...

Read More

The back-end

Trap of foreachRDD in Spark Streaming

January 16, 2024

by Ms. Sandra Henderson

No Comments

Our project needs to consume messages from Kafka, process them, and write them to ActiveMQ to serve as data sources for external systems. Based on...

Read More

reading

How to build a high-throughput logging platform

January 16, 2024

by Ashley Diaz

No Comments

Seven NiuYun at 8 PM on July 24, senior big data architect wang ke in the pegasus web entitled "how to quickly build unified log...

Read More

The back-end

Differences between Kafka partition copy and RocketMQ queue

January 16, 2024

by Justine Twidle

No Comments

In my recent study of Kafka, I have found that its core concepts are somewhat different from RocketMQ. Let me talk about the differences between...

Read More

The back-end

Kafka monitoring components

January 15, 2024

by 田雅萍

No Comments

In this paper, Burrow and Telegraf are used to build Kafka monitoring system. Then, briefly introduce others, such as Kafka Manager, Kafka Eagle, Confluent Control...

Read More

The back-end

How to rebuild indexes in ElasticSearch

January 15, 2024

by Michele Brock

No Comments

Elasticsearch is a real-time distributed search analysis engine . Teambition uses Elastisearch as a search engine to provide search services for users. When we decide...

Read More

The back-end

Differences between Kafka partition copy and RocketMQ queue

January 15, 2024

by Madison Johnson

No Comments

In my recent study of Kafka, I have found that its core concepts are somewhat different from RocketMQ. Let me talk about the differences between...

Read More

The back-end

RabbitMQ vs. Kafka

January 15, 2024

by 徐家瑜

No Comments

As an experienced microservices system architect, I am often asked, "Should I choose RabbitMQ or Kafka?" . For some reason, many developers treat these two...

Read More

The back-end

Follow me: How does Kafka Achieve Millions of concurrent writes per second?

January 15, 2024

by Jessica Holland

No Comments

Here's a look at some of the architecture behind Kafka, one of the most frequently asked questions in interviews with Internet companies. Kafka is a...

Read More

The back-end

From batch ETL to streaming processing: a case from Netflix

January 15, 2024

by 梁筱涵

No Comments

There are many factors to consider and trade-offs to make when migrating batch-based ETL to streaming processing. You can't stream everything just because streaming processing...

Read More

The back-end

360 degree test: Does KAFKA lose data? Is its high availability sufficient?

January 15, 2024

by Jeremy Ward

No Comments

Can Kafka be used in high-availability businesses? The official answer is yes, the latest version already supports message-queued transactions, but we have questions about its...

Read More