Hadoop Cluster Mode
Since it is both storage and processing large data requires considerable disk or processing resource consumption, then the single is certainly do not meet our...
Read More
Tag: hdfs
Hadoop distributed cluster construction
January 26, 2024
by Kim Hamilton
No Comments
This article has been published by netease Cloud community authorized by the author Zhu Xiaoxiao. Welcome to visit netease Cloud Community to learn more about...
Read More
Big data architect classic learning treasure book
January 25, 2024
by Sumer Bandi
No Comments
Some beginners often ask me in blogs and QQ that they want to develop in the direction of big data, what technologies they should learn...
Read More
Apache HAWQ: The evolution of MPP
January 23, 2024
by Thomas Goodman
No Comments
Hive uses Map Reduce or Tez to perform tasks, while Impala uses MPP. I have been familiar with MPP in class, but I don't know...
Read More
Review · Build interactive query system based on Impala platform
January 23, 2024
by Oorja Bali
No Comments
This article is edited and compiled according to "Building interactive Query System based on Impala Platform" shared by Jiang Hongxiang, teacher of netease Big Data,...
Read More
YARN- Exceptions – Big Data In 5 Minutes a Day
January 23, 2024
by Stephanie Caldwell-Webster
No Comments
NodeManager1 The CPU is overloaded. The process is still running but does not send heartbeat messages to ResourceManager. The process repeats the operations described in...
Read More
Change your posture for big data
January 23, 2024
by David Batchelar
No Comments
This article is what I plan to share big data in the company recently. I was used to the All-English Keynote, so the original title...
Read More
As a big data novice, you should understand big data through this article
January 23, 2024
by Patricia Parsons
No Comments
The book "Big Data" defines big data in this way. Big data refers to the use of all the data for analysis and processing instead...
Read More
To become a top big data programmer, pass these Hadoop interview questions first! (Attached answer analysis)
January 22, 2024
by Manikya Goswami
No Comments
With the demand for big data development positions rising, many programmers will choose to switch to programming when they face a career bottleneck. Do you...
Read More
HDFS Router-based Federation
January 22, 2024
by Caitlin Taylor DDS
No Comments
In order to solve the problem of HDFS horizontal scaling, the Hadoop community implemented the ViewFs based Federation architecture in the earlier version, and in...
Read More
Read Region Replica of HBase2.0 in depth
January 22, 2024
by Susan Jones
No Comments
Timeline-consistent High Available Reads (Timeline consistent High Available Reads), also called Region Replica, provides HBase with High availability read capability. This paper mainly introduces the...
Read More
Summary of HBase cross-version data migration
January 22, 2024
by Norman Chapman
No Comments
Abstract: A customer's big data test scenario is as follows: Using Solr image-like data to find user labels, you can query detailed information in HBase...
Read More
Hadoop component: Hbase distributed database
January 22, 2024
by 王欣怡
No Comments
1. Overview of HBase HBase's role in the Hadoop ecosystem HBase is an important member of the Apache Hadoop ecosystem and is mainly used for...
Read More
Big Data Small Perspective 1: From row storage to RCFile
January 21, 2024
by 王家銘
No Comments
Recently, I have been busy writing the graduation project and the project, and haven't written some learning experience and work record for a long time....
Read More
Apache Hadoop (HDFS)
January 21, 2024
by Rachael Cole
No Comments
HDFS is a distributed file system designed to run on commercial machines. It has a lot in common with existing distributed file systems, but there...
Read More
Apache Hadoop
January 21, 2024
by Rebecca Wood
No Comments
This document is the starting point for users to use a Hadpoop Distributed file system (HDFS), either as part of a Hadoop cluster or as...
Read More
EMR(Hadoop /hbase/ Phoenix) Collects data migration pit records in a cluster
January 21, 2024
by Mrs. Sylvia Day
No Comments
I. Overview: Hbase(Phoenix) Data migration schemes are divided into Hadoop layer (distcp) and Hbase layer (copyTable, export/ Import, and Snapshot). 2. Step1: first, open up...
Read More
Hadoop cluster
January 21, 2024
by 沈怡安
No Comments
HDFS uses the Master/Slave architecture to store data. This architecture consists of four parts: HDFS Client, NameNode, DataNode, and Secondary NameNode. Let's take a look...
Read More
Ten years of industry experience and words | attached to big data development beginners tutorial
January 20, 2024
by Robert Williams
No Comments
Some beginners often ask me in blogs and QQ that they want to develop in the direction of big data, what technologies they should learn...
Read More
Momo — August 28, 2017, Intern recruitment
January 20, 2024
by Steven Smith
No Comments
Now taking the bus back to school, just finished the interview brain bomb pain, really unable to review, write a face classics right when relax....
Read More
Practice and evolution of HBase data pipeline facilities
January 20, 2024
by Amber Salazar
No Comments
Abstract: In the 9th China Database Technology Conference, Alibaba technical expert Meng Qingyi explained the practice and evolution of Alibaba HBase data pipeline facilities. This...
Read More
DKhadoop installation package download and monitoring parameters
January 20, 2024
by Alexandra Fowler
No Comments
In the previous stage, I spent almost two weeks to introduce the construction of the running environment of DKhadoop and the various operations of installation....
Read More
MapReduce Integrated exercise case (learn this exercise MapReduce code and you are all set)
January 17, 2024
by Dr. Ian Little
No Comments
Provide two files: information. TXT: student. TXT: questions asked not to partition the result of the former on the local (results) : after the partition...
Read More
Hadoop Combat (10) _Sqoop import and extraction framework encapsulation
January 17, 2024
by Benjamin Begum-Clark
No Comments
Sqoop import is relative to HDFS, that is, import from relational databases to HDFS. Mysql driver package in sqoop/lib. Sqoop --options-file aa.opt run the opt...
Read More
Centos7 Hadoop single-machine deployment mode Installation configuration
January 17, 2024
by Mr. Michael Franklin II
No Comments
Since I need to use Spark now, and Spark will deal with HDFS and Hive, I can't use the distributed cluster configured in the company's...
Read More
Hadoop stable release: DKHadoop
January 16, 2024
by George Kerr-Allen
No Comments
Hadoop is already very familiar to those who work on the Internet. I believe there are many people around us who are switching careers to...
Read More
SparkCore-CacheAndCheckpoint-6
January 16, 2024
by Ojas Garg
No Comments
An important feature that distinguishes it from Hadoop, the cache mechanism ensures that applications that need to access repetitive data (such as iterative algorithms and...
Read More
Hadoop Trip 6- Windows local MapReducer Count offline words
January 16, 2024
by Kathy Manning
No Comments
Through the article the hadoop trip 5 - the idea through the maven build HDFS environment, believe that everyone can do visit HDFS hadoop file...
Read More
Hadoop Combat (1) _ Aliyun builds the pseudo-distributed environment of Hadoop2.x
January 15, 2024
by Ishaan Atwal
No Comments
Bug resolution: 64-bit operating systems cannot run 32-bit applications. Install the 32-bit glibc library. Change hostname, /etc/hosts address must use private address. The wechat official...
Read More
HDFS command Guide
January 15, 2024
by Dr. Angela Moran
No Comments
All HDFS commands are invoked using bin/ HDFS scripts. Empty arguments Running the script displays a description of all commands. Hadoop has an option resolution...
Read More