Tag: hadoop

The back-end

Hadoop framework: Distributed computing framework MapReduce

January 1, 2024

by 張詩涵

No Comments

MapReduce is a programming framework for distributed computing programs and a core framework for users to develop Hadoop-based data analysis applications. The core function of...

Read More

The back-end

Centos-6.8: Hadoop is fully distributed

December 31, 2023

by Susan Baxter

No Comments

1. Download: https://dist.apache.org/repos/dist/release/hadoop/common/ 2. A: http://blog.csdn.net/aircraftxjd

Read More

The back-end

Introduction to MapReduce for Hadoop

December 31, 2023

by Tara Ramirez

No Comments

Instead of piece-by-piece serial computing, MapReduce now distributes the data to multiple people, doing it in parallel, and each person gets a partial aggregation of...

Read More

The back-end

Vmware builds a Hadoop cluster

December 31, 2023

by Kristina Walker

No Comments

Setting up a hadoop cluster in a personal environment prerequisites: three VMS are required. Centos7 is converted from KKB in accordance with jdk1.8 hadoop3.1.4

Read More

The back-end

Hadoop Notes Collection Series 9 -HDFS HA mechanism

December 30, 2023

by Tia Moore

No Comments

Here are some notes on the high availability mechanism of HDFS2.0. In earlier HDFS versions, NameNode had potential single points of failure, but HA was...

Read More

The code of life

Basic Ideas and Principles of MapReduce

December 30, 2023

by Beth Robinson

No Comments

This article introduces the idea of MapReduce in a simple way, and how MapReduce is designed to solve IO problems. It also briefly introduces how...

Read More

The back-end

Hadoop framework: Hadoop cluster construction

December 29, 2023

by Dhanuk Guha

No Comments

Centos7201 Centos7202 Centos7203 NameNode stocking resource

Read More

The back-end

Hadoop cluster construction (Docker version simulates centos multi-machine)

December 29, 2023

by Chirag Chaudhari

No Comments

In a local environment, multiple centos systems are simulated with docker containers. Set up a Hadoop cluster to simulate a multi-machine environment in the same...

Read More

The back-end

Hadoop completely distributed system construction

December 28, 2023

by Jivika Randhawa

No Comments

Hadoop fully distributed mode uses the master-slave architecture, that is, one Namanode and multiple Datanodes. This mode has only one Namanode and is rarely used...

Read More

The back-end

Hadoop Learning 02 — Building a pseudo-distributed cluster

December 28, 2023

by Kara Fuentes

No Comments

This is the 10th day of my participation in the Hadoop Installer Challenge, and the details of the event are as follows: 1. Prerequisites To...

Read More

The back-end

HDFS- Cluster capacity expansion and reduction

December 27, 2023

by Anvi Chandra

No Comments

White Blacklist Whitelist: Indicates that host IP addresses in the whitelist can be used to store data. Enterprise: Whitelist is configured to prevent malicious access...

Read More

Artificial intelligence (ai)

Hadoop streaming,

December 26, 2023

by Alex Hall

No Comments

1/ Function of Streaming 2/ Limitations of Streaming 3/ Form of the Streaming command 4/ Common options 5/ Streaming options 6/Mapper input/output, according to which...

Read More

The back-end

This BigData,Hadoop composition and ecology

December 26, 2023

by Michael Fernandez

No Comments

Introduction With the development of science and technology, we leave more and more data on the Internet, such as online shopping, commodity transactions, small to...

Read More

The back-end

Learning advice: There are so many big data components, you can focus on learning these few

December 25, 2023

by 張思穎

No Comments

Students often ask me, "There are many big data components based on the Hadoop ecosystem, how can WE learn it? After all, our energy is...

Read More

The back-end

Hadoop for the backend (5) : Run the official Hadoop example

December 25, 2023

by Judith Smith-Potter

No Comments

Hi, everyone. I'm Han Shu. Happy Christmas to you all. In the last article Hadoop pseudo-distributed environment construction, we can be described in detail very...

Read More

Artificial intelligence (ai)

The easiest way to play with a Hadoop cluster

December 25, 2023

by Joseph Young

No Comments

Hadoop is mainly divided into three parts: HDFS: Hadoop is specially used for storing files, all the documents

Read More

The back-end

Components of the Hadoop ecosystem

December 25, 2023

by Amelia Jackson

No Comments

Let's take a look at the composition of the Hadoop ecosystem. We will focus on what subprojects the Hadoop ecosystem consists of, what features each...

Read More

The back-end

Hive Description and Use

December 24, 2023

by Bradley Norman

No Comments

Hive Description and Using Hive This section describes hive, a tool based on Hadoop data warehouse. Hive uses HQL to operate. HQL statements are similar...

Read More

The back-end

Configure the Hadoop cluster environment using VMS

December 23, 2023

by Kaia Cole-Brown

No Comments

Now artificial intelligence and big data are hot industries, how can we as programmers not to research, today I start from scratch to look at...

Read More

The back-end

Centos7 install the Hadoop environment

December 23, 2023

by Mr. Denis Woodward

No Comments

3. Install Java and set the corresponding environment variables ***Hadoop3.0 only supports Java8 later versions. *** After downloading the JDK, unzip it and place it...

Read More

The back-end

CDH6.3.1 installation

December 23, 2023

by 金瑋婷

No Comments

This is the 26th day of my participation in the CDH6.3.1 challenge in August. I have encountered many problems in the installation of CDH6.3.1 challenge...

Read More

The back-end

Big Data Environment Preparation Hadoop Cluster construction (three nodes)

December 22, 2023

by Paul Martin

No Comments

Connect a big data server environment preparation. 1. Environment preparation before installing the big data cluster Now that the three machines are fully connected and...

Read More

The back-end

Some Linux basics needed to work with Hadoop

December 21, 2023

by Iain Roberts

No Comments

Linux is a Unix-like operating system, it is a kind of Unix, it controls the whole system basic services of the core program (kernel) by...

Read More

The back-end

Hadoop cluster environment configuration

December 21, 2023

by Jeanette Holden

No Comments

In the last article, we built part of the Hadoop environment. In this article, we continue to build our environment. Combining these two articles, we...

Read More

The back-end

Sqoop is installed and configured for use

December 21, 2023

by Dana Robertson

No Comments

Sqoop installation and configuration using Hive and mysql/ PGSQL data transfer SQOOP installation package upload to Hive-server. Go to hive-server and install sqoop sqoop

Read More

The code of life

Interview series 4 involves the technology Hadoop

December 21, 2023

by Lori May

No Comments

Hadoop configuration file and Simple Hadoop cluster Building 1.3 HDFS Read and write Process 1.3.1 HDFS read process 1.3.2 HDFS write Process 1.3.3 Ma

Read More

The back-end

1. Understand the big data ecosystem

December 21, 2023

by Alexander Miller

No Comments

Big data ecology from the Hadoop framework 1 Big data cognition 1.1 Department business process 1.2 Department organizational structure 2 Hadoop--> Big data ecology 2.1

Read More

The back-end

2021 Big Data Hadoop (II) : A Brief history and features of Hadoop

December 21, 2023

by Robert Morris-Ali

No Comments

2021 Quality creation blog in the field of big data, take you from the entry to the master, the blog is updated every day, gradually...

Read More

The back-end

Hadoop series (1) — Distributed file system HDFS

December 21, 2023

by 呂怡安

No Comments

The Hadoop Distributed File System (HDFS) is a Distributed File System under Hadoop. It features high fault tolerance and throughput and can be deployed on...

Read More

The back-end

Big data platform building | Hadoop cluster structures

December 21, 2023

by Jared Finley

No Comments

NameNode: manages namespaces, stores data block mapping information (metadata), and processes clients' access to HDFS. Handle submitted job requests, resource request requests. A container for...

Read More