Alibaba Cloud message queue Kafka commercialization: support seamless migration of messages to the cloud

On July 25, Ali Cloud announced the official launch of message queue Kafka, a comprehensive integration of open source ecology. On the basis of compatibility with Apache ecology, Ali Cloud message queue Kafka completely solves the pain point of insufficient stability of open source products, availability up to 99.9%, data reliability 99.999999%, and support the seamless migration of messages to the cloud.

Kafka is a distributed, high-throughput, highly scalable message queue service that is widely used in big data fields such as log collection, monitoring data aggregation, streaming data processing, online and offline analysis.

Fully compatible with Apache Kafka ecology

Apache Kafka is known as a persistent messaging product with redundant backup. The product itself was born for distributed big data and has a rich application ecosystem. Ali Cloud message queue Kafka will be fully compatible with the Apache ecosystem, mainly including the following three aspects:

1, can be widely used in the field of big data, such as website behavior analysis, log aggregation, Apps monitoring, streaming data processing, online and offline analysis, etc.

2. Make data integration simple, can import the messages in Kafka to ODPS, HBase, HBase and other offline data warehouses;

3. Can be widely integrated with streaming computing engines, including StreamCompute of Ali Cloud platform, E-MapReduce and open source products Spark, Storm, etc.

Seamless Migration: Build your own Seamless Migration to the Cloud business Edition

From self-built Kafka to Shanghai Cloud, Ali Cloud supports the seamless migration of open source products, providing no barriers to access:

1, Ali cloud message queue Kafka is 100% compatible with open source community Apache Kafka (0.10.0.0 and above version), directly use Kafka open source client can communicate with Ali cloud message queue Kafka;

2, for the original use of open source Apache Kafka users without any transformation, can migrate on the cloud, enjoy ali Cloud to provide message queue Kafka service;

3. Connect with the open source community and Ali cloud platform products, and quickly connect with Kafka’s whole ecology.

Stable and safe: availability 99.9%, data reliability 99.999999%

The lack of stability is a historical legacy of Apache Kafka, Ali Cloud message queue Kafka will be a comprehensive solution to this pain point.

First of all, the product supports massive message accumulation, in the case of massive message accumulation, always maintain the Kafka cluster message receiving, sending high throughput service availability of 99.9%; Secondly, the message will be persistently dropped to the message queue. In the case of sufficient disk capacity, the unexpired data guarantee storage, data reliability up to 99.999999%;

Alibaba has deposited 10 years of enterprise Internet technology on Aliware, which underpins more than 99 percent of large-scale applications. At present, Aliware has launched nearly 10 Aliware products such as enterprise-level distributed application service EDAS, performance test PTS and message queue MQ, providing leading PaaS cloud products for leading enterprises in many fields such as government central enterprises, intelligent manufacturing and new retail. The launch of message queue Kafka will bring convenience to more developers who use Apache Kafka for a long time.