Sentry – Snuba Data Model
Snuba data model is horizontally divided into logical model and physical model. The logical data model is visible to the Snuba client through the Snuba...
Read More
Tag: Big data
In the era of big data, is it thinking or ability that we lack?
January 10, 2024
by Ricky Kerr-Fletcher
No Comments
The most important thing in college should be to train the ability of self-study and cultivate the spirit of self-discipline. After work, the most important...
Read More
Still freaking out about data cleaning? Here is a simple and useful set of cleaning code
January 10, 2024
by Leon Gallagher
No Comments
Towardsdatascience by Admond Lee, Compiled by Geek AI and Qian Zhang. The quality of data in the real world is usually not high. As a...
Read More
After abandoning Excel, wages double, ali factory’s data statements all rely on it
January 10, 2024
by Fiona Sanders-Freeman
No Comments
In the workplace, almost everyone has to work with Excel. Work report form, project progress form, sales performance form, data analysis form...... Excel is used...
Read More
Algorithm – the idea of solving double pointer problem
January 10, 2024
by Andrew Forsyth
No Comments
The use of double Pointers in the algorithm sometimes feels very clever and solves a lot of problems. It is necessary to summarize. First, double...
Read More
A method of sending contract parsing data back to Hive via Python
January 10, 2024
by Christopher Foster
No Comments
1. Event Description: Parses the contract content and sends the result back to Hive for visualization. This event involves the following steps, and the third...
Read More
Take you through Hadoop’s past and present
January 10, 2024
by John Taylor
No Comments
What is the Hadoop? What were the origins of Hadoop? What is the history of Hadoop? This article will take you through the past and...
Read More
Kafka file storage mechanism
January 10, 2024
by Patrick Wilson
No Comments
Kafka is often used in work, but kafka file storage mechanism is not very understanding, this author on kafka file storage mechanism related content review...
Read More
ElasticSearch
January 10, 2024
by Lavanya Hans
No Comments
Elasticsearch is a Restful full-text search engine based on Lucene. Each field is indexed and searchable, and you can quickly store, search, and analyze massive...
Read More
Data warehouse construction method chapter
January 10, 2024
by Mr. Jake Anderson
No Comments
Data is scattered in the data stores used by various departments of the enterprise, and there are complex business connections between them. The whole is...
Read More
HDFS+ClickHouse+Spark: Implement a lightweight big data analysis system from 0 to 1
January 10, 2024
by Michael Mcclain
No Comments
In a product matrix business, you can quickly discover growth problems through the dashboard. However, how to quickly understand the reasons behind a problem is...
Read More
The ORM framework for Elasticsearch is here!!
January 9, 2024
by 吳中山
No Comments
Elasticsearch is a distributed open source search engine for all types of data, including text, digital, geospatial, structured and unstructured data. Elasticsearch Java client: Transpor...
Read More
Construction practice of index system of Didi data warehouse
January 9, 2024
by Valerie James
No Comments
What is the index system? How to use OSM model and AARRR model to build index system? How to unify the process, standardization, tool management...
Read More
Big data need to master the basic algorithms
January 9, 2024
by Norman Roberts
No Comments
Mathematics is like an octopus. It has tentacles that can touch almost every subject. Although most people have systematic learning in school, they just use...
Read More
[Spark Refinement] flatMap of the four RDD operators that must be mastered
January 9, 2024
by Stephanie Hansen
No Comments
Small knowledge, big challenge! This article is participating in the creation activity of "Essential Tips for Programmers". Return the third flatMap in Chapter 2: From...
Read More
Shence analysis Web JS SDK function introduction
January 9, 2024
by William Ortiz
No Comments
Shenze Analysis Web JS SDK is a lightweight data acquisition buried point SDK for Web and H5 terminals. Its core function is data collection and...
Read More
Are you still using pagination? Try MyBatis streaming query, really powerful!
January 9, 2024
by Martin Lane
No Comments
Basic concepts Streaming query refers to the fact that a successful query returns not a collection but an iterator, from which the application takes one...
Read More
Maxwell Collects binlog and sends kafka(Docker installation)
January 9, 2024
by Rebecca Davies-Grant
No Comments
Install each component in Docker mode. Share a tip about maxwell collecting mysql binlog logs and sending them to Kafka
Read More
Introduction to Using Apache Hudi
January 9, 2024
by Lance Stevenson
No Comments
The Apache Hudi scenario discussed in this article is real-time data, not real-time processing. It aims to map time in Mysql to big data platforms...
Read More
Index management system design
January 9, 2024
by Keith Mason
No Comments
A statistical report field produced by the data team is the indicator. Such as the number of orders in the last seven days, the purchase...
Read More
This article explains how to use FusionInsight MRS CDL
January 9, 2024
by Danielle Bowden
No Comments
Abstract: CDL is a simple and efficient real-time Data integration service. It can capture Data Change events from various OLTP databases, push them to Kafka,...
Read More
2021 Tencent Digital Ecology Conference, 10 technology keywords you need to know!
January 9, 2024
by Stephanie Parks
No Comments
What is the Real Internet? What does the virtual-real world look like? What does cloud native and micro-low code mean? What are the opportunities and...
Read More
Use of Scala conversion operators
January 9, 2024
by Seher Bhandari
No Comments
This article describes the usage of the conversion algorithm in Spark, and illustrates the usage of these operators through the function signature, function literal explanation,...
Read More
Spark – Find the most visited person in 500 million visits
January 9, 2024
by Taimur Vora
No Comments
For a large website, the number of visitors is in the billions. We can do some simple calculations here about what a billion is. What...
Read More
Learn about Apache Druid in 10 minutes
January 9, 2024
by William Forrest
No Comments
Apache Druid is an analytical data platform that combines the features of a time series database, data warehouse, and full-text retrieval system. This article takes...
Read More
Read MapReduce
January 9, 2024
by Eileen Edwards
No Comments
MapReduce is Hadoop's solution to large-scale distributed computing. MapReduce is both a programming model and a computing framework. That is, developers must develop programs based...
Read More
Starting Spark (4) Spark map, flatMap, and mapToPair
January 9, 2024
by 黃淑華
No Comments
In the previous section on Spark's classic word statistics, you learned about several RDD operations, including flatMap, Map, reduceByKey, and the later simplified scheme, countByValue....
Read More
What does flatMap mean?
January 9, 2024
by Travis Porter
No Comments
More excellent articles. Recently, an interesting young colleague came on board and submitted lots and lots of code. When you look at the git record,...
Read More
Music data set summary
January 9, 2024
by Jayan Chandran
No Comments
Next, I will study the music recommendation system, which needs data to demonstrate the algorithm and engineering code, and then summarize the open source music...
Read More
How to do a perfect ABTest?
January 9, 2024
by Denise Simmons
No Comments
More and more companies are experimenting with ABTest, either by building their own systems or relying on third-party systems. So what are the basics that...
Read More