一、Hadoop集群配置1、解压并复制文件tar-zxvf/home/software/hadoop-2.8.1.tar.gzmkdir-p/home/opt/hadoop/mv/home/software/hadoop-2.8.1/主页/opt/hadoop/2。修改配置文件cd/home/opt/hadoop/hadoop-2.8.1/etc/hadoop1)configureJAVA_HOMEinhadoop-env.sh2)core-site.xmlfs.default.namehdfs://master:9000hadoop.tmp.dir/opt/hadoop/tmp3)hdfs-site.xmldfs.replication2dfs.namenode.name.dirfile:/opt/hadoop/dfs/namedfs.datanode.data.dir文件：/opt/hadoop/dfs/data4)mapred-site.xmlmapreduce.framework.nameyarnmapreduce.jobhistory.addressmaster:10020mapreduce.jobhistory.webapp.addressmaster:198885)yarn-site.xmlyarn.nodemanager.aux-servicesmapreduce_shuffle<属性><名称>yarn.nodemanager.aux-services.mapreduce.shuffle.class<值>org.apache.hadoop.mapred.ShuffleHandler<属性><名称>yarn.resourcemanager.addressmaster:8032yarn.resourcemanager.scheduler.addressmaster:8030yarn.resourcemanager.resource-tracker.addressmaster:8031yarn.resourcemanager.admin.addressmaster:8033yarn.resourcemanager.webapp.addressmaster:80883。修改slaves文件，添加slave1slave23。将所有配置文件复制到所有机器上4.在master节点上格式化/home/opt/hadoop/hadoop-2.8.1/bin/hdfsnamenode-format5.启动/home/opt/hadoop/hadoop-2.8.1/sbin/start-all.sh/home/opt/hadoop/hadoop-2.8在主节点上。1/sbin/stop-all.sh2.Hadoop自动启动1.进入/etc/rc.d/init.d目录cd/etc/rc.d/init.d2。创建一个新文件hadooptouchhadoop3。添加以下内容，Onlyconfigureinthemaster#!/bin/bash#chkconfig:23452090#description:hadoop#processname:hadoopexportJAVA_HOME=/home/opt/java/jdk1.8.0_151case$1instart)suroot/home/opt/hadoop/hadoop-2.8.1/sbin/start-all.sh;;停止)suroot/home/opt/hadoop/hadoop-2.8.1/sbin/stop-all.sh;;*）回声“需要开始|停止”；；esac4。设置文件权限chmod+xhadoop5.添加开机自启动列表chkconfig--addhadoop6.查看列表chkconfig--list
