Tag: Big data

The back-end

Apache DolphinScheduler – 1.3 series core table structure analysis

February 5, 2024

by Debra Atkinson

No Comments

ApacheDolphinScheduler is a decentralized, easily extensible visual DAG workflow task scheduling system. It is committed to solving the complicated dependency relationship in the data processing...

Read More

The back-end

The ten-step principle solves data quality problems

February 5, 2024

by Nigel Booth

No Comments

The extent to which a set of inherent properties of data meets the requirements of data consumers. True, data is a true reflection of the...

Read More

reading

026-Kettle table Input table output increase 50 times

February 5, 2024

by Badal Kashyap

No Comments

Recent work needs to be done, data needs to be derived from Oracle to Mysql, and it needs to be properly cleaned and converted. The...

Read More

reading

8.Flink Real-time project CEP computing Visitor jump out

February 5, 2024

by Claudia Vasquez

No Comments

To know the details of visitors jumping out, first of all, to identify which is jumping out behavior, to identify the last page that these...

Read More

reading

Pan Shuhui: To understand the value of data intelligence

February 5, 2024

by Tara Kale

No Comments

This paper is organized according to the keynote speech of Pan Shuhui, a consultant of Shence data business, "Intelligent data creation of" hundreds of people...

Read More

The back-end

How to build a fast data lake analysis engine

February 5, 2024

by 楊郁婷

No Comments

Overview: This article provides a detailed overview of the key technologies of the Data Lake analysis engine and uses StarRocks to help users further understand...

Read More

reading

Best practices and FaQs of offline batch Data Channel Tunnels

February 5, 2024

by Charlie Powell

No Comments

This section provides only scenarios where a batch of data is larger than or equal to 64MB. For small-batch streaming data scenarios, use the DataHub...

Read More

The back-end

Practice and application of Flink flow processing in CITIC Jiantou Securities

February 5, 2024

by Amira Goda

No Comments

Citic Jiantou Securities financial real-time data warehouse project leader Liu Chenglong, financial information data r&d engineer CAI Yue in FFA 2021 industry practice special lecture

Read More

reading

Best practices and FaQs of offline batch Data Channel Tunnels

February 5, 2024

by Andrew Sutton

No Comments

This section provides only scenarios where a batch of data is larger than or equal to 64MB. For small-batch streaming data scenarios, use the DataHub...

Read More

The back-end

Clickhouse synchronizes data with Kafka

February 4, 2024

by Michael Hart

No Comments

Clickhouse itself is an analytical database that provides many synchronization solutions with other components. In this article, Kafka will be used as a data source...

Read More

Artificial intelligence (ai)

The practice of building real-time data warehouse based on Flink SQL

February 4, 2024

by 曾哲瑋

No Comments

This paper summarizes the use and tuning experience of Flink SQL in order to help you avoid detour and improve efficiency in real-time computing operations...

Read More

Artificial intelligence (ai)

Paralympic Games underway! Take a look back at China’s 42 years of Winter Olympics and witness a frozen adventure

February 4, 2024

by Cynthia Norton

No Comments

How much do you know about China's "frozen" Winter Olympics? This article reviews the course of The Chinese delegation in the Winter Olympic Games. Based...

Read More

The back-end

Theory of e-commerce warehouse modeling

February 4, 2024

by Anvi Garg

No Comments

A data warehouse is a strategic collection of all types of data to support the decision-making process at all levels of the enterprise. This paper...

Read More

reading

The data analyst got a promotion and a raise this year! What did he do right?

February 4, 2024

by Elakshi Tak

No Comments

Yesterday, I said in my circle of friends that someone got a promotion and a salary increase. Several friends wrote me a private letter, saying...

Read More

The front end

El-table large data volume rendering caton solution

February 4, 2024

by Ryan Holder

No Comments

1. Sometimes the el-table data may have thousands of entries, and it needs to be displayed on a page. At this time, the page renders...

Read More

Artificial intelligence (ai)

10,000 words Flink operator manual: actual combat + principle dry goods

February 4, 2024

by Kerry Rees

No Comments

Flink is based on a stream programming model and has many powerful built-in operators that can help us develop applications quickly. Spend a week to...

Read More

The development tools

StarRocks BE node crash cause lookup: STD ::bad_alloc

February 4, 2024

by 馬宗翰

No Comments

All 5 StarRocks nodes suddenly went offline within a few minutes. Tcmalloc: Large alloc 1811947520 byt

Read More

The development tools

A chart shows you who is interested in Apache Pulsar

February 4, 2024

by Anna Saunders-Baker

No Comments

Multi-tier architecture, scalability, multi-tenancy, and persistence are just some of the reasons why many companies choose Pulsar. To learn more about Apache Kafka, Apache Pulsar,...

Read More

The back-end

Optimization practice of Apache Spark in Haizhi Big data platform

February 4, 2024

by Jill Singh

No Comments

This article is shared by Zhai Shidan from Youhai Network Technology Company. Focus on the field of big data technology, Apache Park contributor, have rich...

Read More

The back-end

Message queues in big data scenarios: quick start Kafka3.0

February 4, 2024

by Lauren Mendoza

No Comments

Kafka is a distributed publish/subscribe message queue and a distributed event flow platform. It can be used not only as message queue, but also as...

Read More

The back-end

How reliable is Kafka?

February 4, 2024

by Taran Lata

No Comments

In practical applications, we have different reliability requirements for Kafka. How can we ensure that Kafka achieves the reliability we want? In this article we...

Read More

The back-end

How do Kafka producers send messages?

February 4, 2024

by Juan Barber Jr.

No Comments

Underneath Kafka there is a process for sending data from producers to consumers. After the producer calls the send method to send the message, it...

Read More

reading

Understand the design and practice of K8s log system

February 4, 2024

by Kevin Morgan

No Comments

Technology architecture is the process of transforming product requirements into technology implementations. It is fundamental and important for all architects to be able to thoroughly...

Read More

The back-end

Xiaomi Big Data: Build efficient and easy-to-use one-stop OLAP solution with Apache Kylin

February 4, 2024

by 李佩珊

No Comments

Xiaomi is now more of a big data and artificial intelligence company than a phone company. With the rapid development of various businesses of Xiaomi,...

Read More

reading

Kylin official case analysis and pruning optimization -OLAP business environment combat

February 4, 2024

by Lisa Lopez

No Comments

Copyright Notice: This set of technical column is the author (Qin Kaixin) usually work summary and sublimation, through extracting cases from real business environment to...

Read More

The back-end

In the era of big data, do you really know App data privacy security?

February 4, 2024

by 金郁婷

No Comments

Brief introduction: Have you ever had the experience: you chat with your friends and say that you want to buy a certain product recently, and...

Read More

reading

Blockbuster! All you need to know is here

February 4, 2024

by 張惠婷

No Comments

The National Development and Reform Commission (NDRC), the Cyberspace Administration of the CPC Central Committee (CAC), the Ministry of Industry and Information Technology (MIIT) and...

Read More

The back-end

[Big Data Set 20210117] How to achieve high reliability Kafka

February 4, 2024

by Catherine Mann

No Comments

Data reliability Kafka as a commercial level messaging middleware, the importance of message reliability can be imagined. This article introduces the reliability of data from...

Read More

reading

Introduction of data platform and Flink task operation principle

February 4, 2024

by Kathryn Collins

No Comments

The data platform is based on Flink computing framework, integrated with Kafka, Clickhouse and other big data components, with data acquisition, data synchronization, data storage,...

Read More

The code of life

YunDa based on cloud native business | China construction of actual combat

February 4, 2024

by Stephanie Parks

No Comments

This article will share yunda business in Taiwan based on cloud native construction process. IT is mainly divided into three parts, the first part is...

Read More