Hadoop Enterprise Production Tuning Manual (Part 1)
"This is the 26th day of my participation in the November Gwen Challenge. See details of the event: The Last Gwen Challenge 2021". 1.1 NameNode...
Read More
Tag: hadoop
[Eyes light up!] See how Hadoop’s underlying algorithms elegantly improve large-scale cluster performance by more than 10 times?
January 29, 2024
by Robert Maddox
No Comments
In this article, we will talk about the performance optimization of the file contract monitoring algorithm when Hadoop is deployed in a large-scale cluster scenario...
Read More
Hadoop Cluster setup tutorial with 14 process screenshots
January 29, 2024
by Steven Ferrell
No Comments
• Hadoop is a distributed storage and computing platform provided by the Apache Foundation. This article will take you through the process of building a...
Read More
5 must-know Big Data Processing framework Technologies
January 29, 2024
by 丁宗翰
No Comments
Here are 5 must-know big data processing framework technologies. Big data is an umbrella term for the unconventional strategies and techniques needed to collect, organize,...
Read More
Hadoop several important parameter configuration
January 29, 2024
by 林宜君
No Comments
Fs. defaultFS file:/// HDFS ://node1:9000 specifies the name of the default file system. URI form. The uri's scheme needs to be specified by (fs.scheme.impl) as...
Read More
Hadoop complete setup process (1) : local mode
January 29, 2024
by Dr. Russell Brown
No Comments
Local mode is the simplest mode, where all modules run in a JVM process and use a local file system instead of HDFS. The local...
Read More
[Secret of Performance Optimization] How can Hadoop optimize the performance of large terabyte files upload by 100 times?
January 29, 2024
by Dawn Becker
No Comments
In our last article, we talked about the Edits log writing mechanism in NameNode in Hadoop. When edits log is written to disk and network,...
Read More
117 questions about big data interview analysis, I hope to help you
January 29, 2024
by 何宗翰
No Comments
The map output is stored in the buffer. When the cache reaches a certain threshold, the data is spilled to the disk. Then partition, sort,...
Read More
Will the Docker ecosystem go the way of Hadoop?
January 29, 2024
by Armaan Brahmbhatt
No Comments
Will the Docker ecosystem go the way of Hadoop? SparkMesosgoogl is an open source image cluster and PaaS container
Read More
Hadoop Complete Setup process (3) : Fully Distributed mode (VM)
January 29, 2024
by Nina Butcher
No Comments
Three VMS need to be used, one of which is the Master node and two Worker nodes. The first step is to install the VM...
Read More
Hadoop series (7) -Hadoop Infrastructure – Distributed mode and high availability mode
January 29, 2024
by Ivana Dave
No Comments
This is the 7th day of my participation in the November Update Challenge. The details of the event are as follows: 2021 Last Update Challenge...
Read More
Big data development and technology related to big data
January 29, 2024
by Mamooty Din
No Comments
In today's world, with the rapid development of Internet technology, there are many friends asking questions about big data, such as what is big data...
Read More
How to estimate the reliability of a distributed storage system?
January 29, 2024
by 喬彥廷
No Comments
Welcome to visit netease Cloud Community to learn more about Netease's technical product operation experience. In general, we use multi-copy technology to improve the reliability...
Read More
Hadoop Complete Setup Process (iv) : Fully distributed mode (server)
January 29, 2024
by Angela McKay
No Comments
The last article introduced how to build a cluster using virtual machines, but this article is the actual combat, using three real servers to build...
Read More
Centos7 Hive single-machine deployment mode Installation and configuration
January 29, 2024
by Lavanya Khosla
No Comments
Because you only learn hive on your own VM, you only need to configure hive in the simplest way. Other complex configuration files are not...
Read More
HIVE permission control and super administrator implementation
January 29, 2024
by John Ford
No Comments
From the remote Hive deployment and mysql metadata table dictionary, it is clear that Hive manages user permissions through information stored in metadata. The focus...
Read More
The most detailed Hadoop environment setup ever (Part 2)
January 29, 2024
by Michele Brock
No Comments
Following the previous "Most Detailed Hadoop Environment Setup ever (Part 1)" "Most Detailed Hadoop Environment Setup Ever (Part 2)"
Read More
Meizu big data operation and maintenance platform practice
January 29, 2024
by Dale Cooke-Bishop
No Comments
At the end of 2013, we began to practice big data and deployed a test cluster. At that time, there were only three nodes, because...
Read More
Hard drives may lose data, but is distributed storage reliable?
January 29, 2024
by 孫哲瑋
No Comments
This article has been authorized by the author Sun Jianliang netease cloud community. Welcome to visit netease Cloud Community to learn more about Netease's technical...
Read More
The most detailed Hadoop environment setup ever (Part 1)
January 29, 2024
by Ishita Batta
No Comments
This is an introductory article, and there are many ways to learn Hadoop. The idea of this paper is: to install and deploy Apache Hadoop2.x...
Read More
Hadoop technology innovation solutions for big data industry
January 29, 2024
by Cassandra Gallagher
No Comments
Today, many companies are trying to mine the vast amount of data they own, including structured, unstructured, semi-structured and binary data, to explore the further...
Read More
Hadoop Cluster Building
January 29, 2024
by Samuel Bary
No Comments
2. Modify the configuration file to modify/hadoop2.7.1 / etc/hadoop/hadoop - env. 4. Add Slaves in the same path as the slave node (Datanode)
Read More
DKhadoop helps implement the national Big data strategic plan
January 29, 2024
by Keya Bahri
No Comments
If you want to ask what is the hottest in the current Internet industry, it is big data and block chain. On December 8, 2017,...
Read More
Hadoop 3.2.x HA cluster construction
January 29, 2024
by Amber Miller
No Comments
1.1. Install JDK 1.3 to create folders, as for why these paths, and the following configuration file related.
Read More
Query optimization practice for MaxCompute complex data distribution
January 29, 2024
by 蘇佳玲
No Comments
The 2017 China Big Data Technology Conference was held in Crowne Plaza Yunnan Hotel, Beijing from December 7 to 9. The conference held in-depth discussions...
Read More
Analysis of Flink Table/SQL API
January 28, 2024
by Nicola Brookes-Williams
No Comments
Relational apis have many benefits: they are declarative, the user only needs to tell them what is needed, and the system decides how to calculate;...
Read More
Where will the architect talk to you on the weekend: quick solutions for big data platforms
January 28, 2024
by Cheryl Harrison-White
No Comments
Content source: on May 13, 2017, the weekend where architects Li Ximing in "the beauty of Java developers conference | Java [Shanghai]" to "the big...
Read More
Hadoop, hive, sqoop, hbase, introduction of hue
January 28, 2024
by Kathy Owens
No Comments
Hadoop distributed computing/storage, open source framework 2. Hive Query analysis [SQL on Hadoop] Data warehouse tool 2.2 Tables in Hive are purely logical tables, such...
Read More
Hadoop Tour 9-centerOS7: hbase cluster environment Construction
January 28, 2024
by Christopher Decker
No Comments
Ok, so you may be confused by the concept, so I will directly lead you to build an environment and do some simple applications to...
Read More
HBase: The HMaster service automatically stops and HRegionserver cannot be stopped when the cluster is shut down
January 27, 2024
by Megan Jenkins
No Comments
First, this is a problem that happened more than half a month ago. Please note the background while the historical records are still available: there...
Read More