ClickHouse AggregatingMergeTree
1. The table engine inherits from MergeTree and can use AggregatingMergeTree to aggregate incremental data statistics. If you want to combine and reduce the number...
Read More
Tag: Big data
Development efficiency increased by 15 times! Batch streaming converged real-time platform in good future application practice
January 18, 2024
by 高靜宜
No Comments
Good future is an education technology company founded in 2003, under the brand xueersi, now you hear of Xueersi Peyou, Xueersi online school are derivatives...
Read More
Build a Web application based on Aliyun container service -Kubernetes in one hour
January 18, 2024
by Lauren Mendoza
No Comments
If you are a beginner to Kubernetes, this article can help you quickly set up a working cluster environment on the cloud and launch your...
Read More
When the 10-year BI data director encountered bad requirements and bad data, he did these things
January 18, 2024
by Renee Hayre
No Comments
IT people will inevitably have bad projects in their careers. Some projects are bad when you join them, some are bad when you start from...
Read More
Flink a environment build, output wordCount
January 17, 2024
by Spencer Pham
No Comments
1. Flink environment build 1.1 Flink version list: https://archive.apache.org/dist/flink/ 1.2 select the latest 1.12.2 version 1.3 unzip the installation checks
Read More
JanusGraph Problem Notes – Local configuration not working?
January 17, 2024
by Marion Johnson
No Comments
Error: Unrecognized mode: manager93.bigdata, Unrecognized mode: manager93.bigdata, Unrecognized mode: Manager93. bigdata, Unrecognized mode: Manager93. bigdata, Unrecognized mode: Manager93. bigdata (Buttress!) It's the same mistake, but...
Read More
JanusGraph enters the first lesson and stomps on official documents
January 17, 2024
by Victor Henson
No Comments
Continue to execute demo. It is running successfully.
Read More
Classification/clustering results evaluation indicators: TP, TN, FP, FN, Purity, F-SCROE (F score) Python implementation
January 17, 2024
by Nicholas Blake
No Comments
, where K is the number of cluster, and M is the number of members involved in the whole cluster division. The following table is...
Read More
Spark Data skew and its solution
January 17, 2024
by 王雅涵
No Comments
This document describes the hazards, symptoms, and causes of data skew and the solutions for Spark data skew. For distributed big data systems such as...
Read More
A good scheme to help you achieve complex data sources in the cell information accurate normalization
January 17, 2024
by Julia Stephenson
No Comments
Residential area is very important information in rental business, it can reflect the location and quality of housing. For tenants, the ability to browse accurate...
Read More
The core concept of Spark is RDD
January 17, 2024
by Dr. Nathan Davis
No Comments
Resilient Distributed Dataset (RDD) Resilient Distributed Dataset (RDD) is the most basic abstraction in Spark. It represents an immutable and partitioned collection of elements that...
Read More
The architecture and challenges of Alibaba Service Mesh implementation
January 17, 2024
by 周詩涵
No Comments
Before getting to the topic, we need to explain the deployment architecture of the core application of Double 11, as shown in the figure below....
Read More
Data Governance – TextFile format Hive table compression optimization practices
January 17, 2024
by Kate Flood
No Comments
Due to the lack of unified specification implementation and platform tool support, most service personnel and technical personnel do not consider the importance of Hive...
Read More
Elastic Search practices in SpringBoot
January 17, 2024
by Nitara Biswas
No Comments
You'll need to install Elastic Search, and you'll need to install elasticSearch-Head to see your data visually. JNA not found. Native methods will be disabled....
Read More
Practice of user growth scheme based on MaxCompute+PAI
January 17, 2024
by Todd Payne
No Comments
How to use PAI+MaxCompute to complete the AARRR link of user growth model, including drive new, promote live, retain, generate revenue, share. The author of...
Read More
Alibaba e-commerce search recommended real-time number warehouse evolution
January 17, 2024
by Lance Stevenson
No Comments
1. Business background Alibaba e-commerce Search and recommendation real-time data warehouse carries the real-time data warehouse scenarios of Alibaba Group Taobao, Taobao Special Edition, Ele....
Read More
Basic implementation principles of SparkSQL
January 17, 2024
by 胡欣怡
No Comments
SparkSQL is another outstanding module in spark stack. By introducing SQL support, it greatly reduces the use cost of developers and learners. It enables developers...
Read More
Live broadcast of IDE plug-in and VS Code new version, 8 times faster development and deployment
January 17, 2024
by Cynthia Smith
No Comments
Last year, Ali Cloud released the local IDE plug-in Cloud Toolkit, IntelliJ IDEA platform alone, more than 150,000 developers downloaded, experienced the one-click deployment brought...
Read More
How to start Spark quickly
January 17, 2024
by Frankie Harris
No Comments
With the development of the Internet, big data has become a new generation of "Internet celebrities". Almost all walks of life are related to big...
Read More
To use Spark well, you need to understand the underlying logic.
January 17, 2024
by Pam Clark
No Comments
Hello, I'm Fan Donglai. Today we are going to talk about a relatively basic and important content called MapReduce. The reason why MapReduce is fundamental...
Read More
DataX’s practice in big data platform
January 17, 2024
by Donna Morgan
No Comments
In the early days of big data technology application, we used Sqoop as a data synchronization tool to meet the daily development requirements of data...
Read More
Spark Field — Build our Spark distributed architecture
January 17, 2024
by Rebecca Hunt
No Comments
As we all know, the other thing that makes Spark powerful is its distributed architecture, in addition to its powerful data processing capabilities. As an...
Read More
System RM is recommended
January 16, 2024
by Callum Hussain
No Comments
According to the speed of response to user behavior, the system can be roughly divided into offline training and online training. Offline training recommendation system...
Read More
Introduction to Flink (I) – Introduction to Apache Flink
January 16, 2024
by Erin Hammond
No Comments
What is ApacheFlink? In the era of rapid data volume, a large number of business data are generated in various business scenarios. How to effectively...
Read More
Apache Ranger compiled and installed
January 16, 2024
by Dominic Carr
No Comments
Open Source Developer Notes: DevOps, microservices, distribution, Big data, high availability, blockchain, whitepapers, Algorithms, hacking, design patterns, interview questions. Star ⭐️ Apache Ranger is a...
Read More
Route and Practice of Autonavi SD Map Data Production Automation Technology (Road Part)
January 16, 2024
by Victoria Parker
No Comments
In recent years, the infrastructure construction of domestic road traffic and related facilities is changing with each passing day. The vast number of users have...
Read More
Graphs – 1. An overview
January 16, 2024
by Jocelyn Morris
No Comments
Map When the MapTask is executed, the input data is from the HDFS Block. For example, if there are three files in a directory with...
Read More
Basic concepts of Spark
January 16, 2024
by Lisa Tran
No Comments
The real-time requirements of different computing frameworks are gradually increasing. Spark is a layer 4 computing framework in the whole big data technology framework. Spark...
Read More
Big data ZooKeeper knowledge points, Lao Liu is really very careful
January 16, 2024
by Anahita Varma
No Comments
Preface: Old Liu is at present for next year school recruit but diligently, write an article basically is to want to use plain English the...
Read More
JupyterHub on Kubernetes: How to build Tubi Data Science Platform
January 16, 2024
by William Mendoza
No Comments
When we first introduced Tubi Data Runtime (TDR) [1], it was just a Python library, and early users liked its features. But if we put...
Read More