Hadoop Cluster Installation

The article directories

• • 1. Step8:NameNode format
  • 2. Start and stop the Hadoop cluster – Manually start and stop one process at a time
  • 3. Start and stop the Hadoop cluster – Shell script starts and stops with one click
  • 4. Hadoop cluster startup logs
  • 5. Hadoop Web UI -HDFS cluster
  • Hadoop Web UI page -YARN Cluster

1. Step8:NameNode format

• You must format the HDFS when it is started for the first time.
• Format is essentially initialization work, HDFS cleanup and preparation work
• Command:

hdfs namenode -format
Copy the code

2. Start and stop the Hadoop cluster – Manually start and stop one process at a time

hdfs --daemon start namenode|datanode|secondarynamenode
hdfs --daemon stop  namenode|datanode|secondarynamenode
Copy the code

yarn --daemon start resourcemanager|nodemanager
yarn --daemon stop  resourcemanager|nodemanager
Copy the code

3. Start and stop the Hadoop cluster – Shell script starts and stops with one click

• On Node1, use the shell script delivered with the software to start with one click
• Prerequisites: SSH password-free login and workers files have been configured between machines.
• HDFS cluster

start-dfs.sh 
stop-dfs.sh 
Copy the code

• YARN cluster

start-yarn.sh
stop-yarn.sh
Copy the code

• Hadoop cluster

start-all.sh
stop-all.sh 
Copy the code

4. Hadoop cluster startup logs

5. Hadoop Web UI -HDFS cluster

• Address: http://namenode_host:9870
  
  Namenode_host is the host name or IP address of the host where namenode is running
  
  Don’t forget to configure hosts on Windows if you use a host name for access
  
  
• Viewing the HDFS Web page
  
  
  
  

Hadoop Web UI page -YARN Cluster