1.Hadoop简介

是一个由Apache基金会所开发的开源分布式系统基础框架，使用Java开发，是处理大规模数据的软件平台。

Hadoop可以从单一节点扩展到上千节点。用户可以在不了解分布式底层细节的情况下，开发分布式程序。充分利用集群的威力进行高速运算和存储。

本次安装的是单点问题

2.安装Java JDK

由于Hadoop使用Java编写，要运行它我们需要安装Java运行环境

jdk下载地址: http://www.oracle.com/technetwork/java/javase/downloads/index.html

hadoop下载地址: https://mirrors.tuna.tsinghua.edu.cn/apache/hadoop/core/

#1.把事先准备好的包放到/usr/local/src下[root@hadoop_master src]# lltotal 445732-rw-r--r-- 1 root root 266688029 Nov 17 14:08 hadoop-2.7.4.tar.gz-rw-r--r-- 1 root root 189736377 Nov 13 15:37 jdk-8u151-linux-x64.tar.gz[root@hadoop_master src]# tar xf jdk-8u151-linux-x64.tar.gz [root@hadoop_master src]# mv jdk1.8.0_151/  /usr/local/jdk#2.在环境变量追加export JAVA_HOME=/usr/local/jdkexport JRE_HOME=$JAVA_HOME/jreexport CLASSPATH=.:$JAVA_HOME/jre:$JRE_HOMEexport PATH=$JAVA_HOME/bin:$PATH#3.创建用户[root@hadoop_master src]# useradd hadoop[root@hadoop_master src]# passwd hadoopChanging password for user hadoop.New password: BAD PASSWORD: The password is shorter than 8 charactersRetype new password: passwd: all authentication tokens updated successfully.

3.解压hadoop包

[root@hadoop_master src]# tar xf hadoop-2.7.4.tar.gz [root@hadoop_master src]# mv hadoop-2.7.4 /usr/local/hadoop[root@hadoop_master src]# chown -R hadoop:hadoop /usr/local/hadoop/

4.配置hadoop

[root@hadoop_master src]# su - hadoop[hadoop@hadoop_master ~]$ vi .bashrc export JAVA_HOME=/usr/local/jdkexport PATH=$PATH:$JAVA_HOME/binexport CLASSPATH=.:$JAVA_HOME/jre/lib:$JAVA_HOME/lib:$JAVA_HOME/lib/tools.jarexport HADOOP_HOME=/usr/local/hadoopexport HADOOP_INSTALL=$HADOOP_HOMEexport HADOOP_MAPRED_HOME=$HADOOP_HOMEexport HADOOP_COMMON_HOME=$HADOOP_HOMEexport HADOOP_HDFS_HOME=$HADOOP_HOMEexport YARN_HOME=$HADOOP_HOMEexport HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/nativeexport PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin[hadoop@hadoop_master ~]$ source .bashrc [hadoop@hadoop_master ~]$  cd $HADOOP_HOME/etc/hadoop[hadoop@hadoop_master hadoop]$ vi hadoop-env.shexport JAVA_HOME=/usr/local/jdk[hadoop@hadoop_master hadoop]$ grep "JAVA" hadoop-env.sh# The only required environment variable is JAVA_HOME.  All others are# set JAVA_HOME in this file, so that it is correctly defined onexport JAVA_HOME=/usr/local/jdk    #修改后的结果#HADOOP_JAVA_PLATFORM_OPTS="-XX:-UsePerfData $HADOOP_JAVA_PLATFORM_OPTS"

编辑core-site.xml文件


     
        
       
        fs.default.name
           
       
        hdfs://localhost:9000

编辑hdfs-site.xml文件：


     
       
       
        dfs.replication
        
       
        1
       
       
        
       
        dfs.name.dir
         
       
        file:///usr/local/hadoop/hadoopdata/namenode
       
       
        
       
        dfs.data.dir
         
       
        file:///usr/local/hadoop/hadoopdata/datanode

[hadoop@hadoop_master hadoop]$ mkdir -p /usr/local/hadoop/hadoopdata/namenode  /usr/local/hadoop/hadoopdata/datanode /usr/local/hadoop/hadoopdata

创建mapred-site.xml文件：

[hadoop@hadoop_master hadoop]$ cp mapred-site.xml.template mapred-site.xml
      
        
       
        mapreduce.framework.name
         
       
        yarn

编辑yarn-site.xml文件:配置了Hadoop单节点

[hadoop@hadoop_master hadoop]$ cat yarn-site.xml
     
      
        
       
        yarn.nodemanager.aux-services
         
       
        mapreduce_shuffle

初始化HDFS文件系统：

[hadoop@hadoop_master hadoop]$ hdfs namenode -format

Hadoop相关脚本:

[hadoop@hadoop_master hadoop]$ cd ../../sbin/[hadoop@hadoop_master sbin]$ lsdistribute-exclude.sh  hdfs-config.sh           refresh-namenodes.sh  start-balancer.sh    start-yarn.cmd  stop-balancer.sh    stop-yarn.cmdhadoop-daemon.sh       httpfs.sh                slaves.sh             start-dfs.cmd        start-yarn.sh   stop-dfs.cmd        stop-yarn.shhadoop-daemons.sh      kms.sh                   start-all.cmd         start-dfs.sh         stop-all.cmd    stop-dfs.sh         yarn-daemon.shhdfs-config.cmd        mr-jobhistory-daemon.sh  start-all.sh          start-secure-dns.sh  stop-all.sh     stop-secure-dns.sh  yarn-daemons.sh

启动Hadoop服务

[hadoop@hadoop_master sbin]$ start-dfs.sh     #启动Hadoop[hadoop@hadoop_master sbin]$ start-yarn.sh   #启动yarn[hadoop@hadoop_master sbin]$ jps                  #查看服务状态3664 NameNode4368 NodeManager4771 Jps3785 DataNode3945 SecondaryNameNode4090 ResourceManager