Tag: Big data

The back-end

With big data surrounding you and me, how can technical people share knowledge

January 4, 2024

by Dr. Russell Brown

No Comments

Abstract: How do these data gradually surround your life and mine? Huawei cloud expert Zhou Peiyuan, who has worked in the big data industry for...

Read More

The back-end

Retrieve Selected fields from a search for Elasticsearch 7.10

January 4, 2024

by Kevin Arroyo

No Comments

By default, each hit in the search response contains the document _source, which is the entire JSON object provided when the document is indexed. To...

Read More

reading

Deep interpretation of Kafka data reliability

January 4, 2024

by 丁怡安

No Comments

How kafka data reliability is guaranteed? This article explains kafka's efforts to ensure data reliability, and provides an in-depth explanation and analysis of related concepts.

Read More

reading

Hadoop serialization and slicing mechanism

January 4, 2024

by Sarah Carter

No Comments

Hadoop serialization and slicing mechanism introduction, for slicing mechanism part of the content, citing source code and examples to explain the serialization method of custom...

Read More

The code of life

The ExecutorService thread pool

January 4, 2024

by Miraan Lad

No Comments

1. Class Handler implements Runnable{}2 Establish the ExecutorService thread pool ExecutorService ExecutorService = Executors. NewCachedThreadPool (); Or int cpuN...

Read More

The back-end

Apache DolphinScheduler 2.0 DAG core JSON unpacking

January 4, 2024

by Mary Baker

No Comments

This article takes a detailed look at the JSON debunking of the Apache DolphinScheduler 2.0 DAG core

Read More

The code of life

Singleton pattern (Design Pattern 1)

January 4, 2024

by Cassandra Gallagher

No Comments

The computer manager, once created a task manager, to create the same again. 1. Singleton mode: Hangry. Two, lazy: with delayed loading. Add synchronization, call...

Read More

The back-end

ClickHouse Real -001-ClickHouse installation and deployment

January 4, 2024

by Cameron Buchanan

No Comments

Basic configuration environment | dependence version | | | : - : | -- - | | ClickHouse | 20.11.3.3-2 | | CentOS | 7...

Read More

reading

Super detailed tutorial! How to build openLooKeng development environment in Windows

January 4, 2024

by Jackson Thomas

No Comments

Super detailed tutorial! Build openLooKeng development environment in Win! When we are in openLooKeng project tasks, many situations need to be developed and debugged under...

Read More

Artificial intelligence (ai)

Alibaba’s Big Data Practice | Real-time Technology Streaming Data Model (III)

January 4, 2024

by Saira Mahal

No Comments

Data layering in the streaming data model, the data model as a whole is divided into five layers. 1. Definition of ODS offline system

Read More

The back-end

Big Data Development – FAQ on Linux

January 4, 2024

by Navya Sastry

No Comments

1. The problem of userssiscurrentlyuserbyprocess3234 reasons: root > ss - > root stack as recursive solution: exit out of the current to ss and exit...

Read More

The code of life

Flink Yarn Per Job – Start TM, register with RM, and RM assigns SOLT

January 4, 2024

by 李馨儀

No Comments

! [Flink Yarn Per Job - Start TM, register with RM, and RM allocates solt_ one long figure 1.jpg](https://p9-juejin.byteimg.com/tos-cn-i-k3u1fbp

Read More

The code of life

2021 Latest Big Data Learning Route (complete and detailed version, including free information)

January 4, 2024

by Mark Mccoy

No Comments

Hello, I am your friend Ying Zhuo. I have been working in China Electronics, Meituan and Bytedance for ten years in the field of big...

Read More

The front end

How to access Damon database in flink program?

January 4, 2024

by 王怡君

No Comments

Background Use Flink to consume events, calculation rules, and dimension data in Kafka stored in dameng database. Dameng database management system is a high performance...

Read More

The code of life

Storm learn all options and definitions of 00-storm configuration file

January 4, 2024

by 李懿

No Comments

Storm configuration file options and definitions

Read More

The back-end

The key technology of Baidu rich media search comparison system is explained in detail

January 4, 2024

by 高靜宜

No Comments

At present, Baidu rich media search and comparison system not only undertakes the anti-cheating, redistributing, associated recommendation and anti-pornography businesses of all videos and images...

Read More

reading

Designing Data Intensive Applications (DDI) Reading Notes (5)

January 4, 2024

by Hailey Lopez

No Comments

This week, the progress of the reading group came to chapter 6. I have finished reading the whole DDIA, but I still need to write...

Read More

reading

Install the TensorFlow development environment in Linux

January 4, 2024

by Nicola Ryan-Brooks

No Comments

The first step is to download Anaconda, a freemium open source distribution of the Python language for large-scale data processing, predictive analytics, and scientific computing...

Read More

The code of life

HDFS Storage(1)

January 3, 2024

by 唐佩珊

No Comments

Hadoop is extensible and designed for different file systems, and users or programs can access specific file systems in command line code with special URI...

Read More

reading

Detail the use of Look up dimension table in FLink

January 3, 2024

by 賴俊賢

No Comments

In streaming computing, dimension table is a very common concept, which is generally used in SQL JOIN for data completion of streaming data. For example,...

Read More

The development tools

This article explains Session, Cookie and Token

January 3, 2024

by Kanav Sen

No Comments

I have read many articles of the same type before. There are different opinions on cookies and sessions. Some people say that there are cookies...

Read More

The back-end

Custom Presto plug-in

January 3, 2024

by Ms. Jennifer Byrne

No Comments

According to the regulations issued by the state, we need to encrypt and store users' private data, such as mobile phone numbers and IP addresses....

Read More

The back-end

Small white also can understand Hive tuning

January 3, 2024

by Tasha Miller

No Comments

Hive is a common big data component. The performance of Hive is affected not by a large amount of data but by data skew, redundancy,...

Read More

reading

Talk about the details of self-learning big data flume that are easily overlooked

January 3, 2024

by Tanya Krishnamurthy

No Comments

Preface: Lao Liu can not guarantee how good, but it is definitely very conscientious about self-learning big data development on the road of some experiences...

Read More

The back-end

Big Data Learning Road 9: Overview of MapReduce

January 3, 2024

by Dr. Nathan Davis

No Comments

To learn something, we need to know what is it? What can it do? How does it work? These three questions. This article will give...

Read More

The back-end

Volcano Engine Stream Batch data quality solutions and best practices

January 3, 2024

by Tasha Miller

No Comments

This paper introduces how the Volcano Engine data quality platform can bridge the conflict between data quality verification and computation in big data scenarios, and...

Read More

The back-end

Big Data Development -Go- Initial Go && Common features

January 3, 2024

by Kelly Watts-Jackson

No Comments

Go provides several basic but non-essential types, such as slices, interfaces, and channels. Go simplicity is not its main selling point. As a static language,...

Read More

The back-end

Pulsar Consumer and thread pool are used improperly

January 3, 2024

by Nitya Wagle

No Comments

The average processing speed of each message is about 10 seconds. The throughput is found to be very slow. According to the log observation, the...

Read More

The back-end

Volcano efficient scheduling capability practice in big data scenarios

January 3, 2024

by Ellie Taylor

No Comments

This article will introduce the development history and working principle of SparkonKubernetes, and the second part will roughly introduce SparkwithVolcano, and how Volcano can help...

Read More

The back-end

Overturned again? List click events to collect those pits you don’t know!

January 3, 2024

by Gregory Harris

No Comments

In the previous article "Seven Steps to Realize Collection of List Click Events", we have introduced in detail how to create subclasses to collect cell...

Read More