MacOS下编译Hadoop-2.9.2系统环境：MacOS_10.14.4maven:ApacheMaven3.6.0jdk:jdk_1.8.0_201ProtocolBuffer:portoc-2.5.0zlib:1.2.3-libOpenSSL:1_0_2rcmale:3.14.3-win64-x64Cygwin:2.897_x86_64hadoop:hadoop-2.9.2snappy:搭建编译环境1、在oracle官网下载安装java环境，配置好环境变量。2.Maven我用`brewinstallmaven直接用brew安装`3.cmake使用brew安装`brewinstallcmake`4.openssl使用brew安装`brewinstallopenssl`5.snappy使用brew安装`brewinstallsnappy`6.zlib使用brew安装`brewinstallzlib`7.protobuf是必须的要使用2.5.0版本，需要[download](https://github.com/protocolbuffers/protobuf/releases)安装下载，然后解压进入protobuf目录#配置$./configure--prefix=/usr/local/Cellow/protoc/2.5/#编译$make#安装$makeinstall#配置环境变量`~/.bash_profile`或`~/.zshrc`exportPATH="/usr/local/Cellow/protoc/2.5/bin:$PATH"#验证协议版本$protoc--version可能会遇到问题1.[ERROR]Failedtoexecutegoalorg.apache.maven.plugins:maven-antrun-plugin:1.7:run(make)onprojecthadoop-pipes:AntBuildExceptionhasoccurred:execreturned:1[错误]ar声音Ant部分......@5:153in/Users/Downloads/hadoop-2.9.2/hadoop-tools/hadoop-pipes/target/antrun/build-main.xml解决方法：这个xml中的编译指令需要使用一个环境变量OPENSSL_ROOT_DIR因为我们之前没有配置，所以执行的时候会报错。您需要在~/.bash_profile或~/.zshrc中指定OPENSSL_ROOT_DIR的安装目录。我的配置是exportOPENSSL_ROOT_DIR="/usr/local/Cellor/openssl/1.0.2r"2。由于OpenSSL存在重大漏洞，MacOS没有使用OpenSSL，而是使用了LibreSSL。你可以在你的Mac上执行whichopenssl，然后找到/usr/bin/openssl，执行/usr/bin/openssl版本，会出现LibreSSL2.6.4，但是必须使用openssl来编译hadoop。可以将引用的名字改成openssl，但是Mac不允许关闭Mac的保护模式，但不建议这样做。我们可以修改系统shell的环境变量，让自己配置的环境变量覆盖系统的环境变量，例如：exportPATH="/usr/local/Cellor/openssl/1.0.2r/bin:$PATH"编译hadoop#下载[hadoop源码](https://hadoop.apache.org/releases.html)#解压进入hadoop源码路径#执行一条maven命令（你的maven需要在环境变量中配置）$mvnpackage-Pdist,native-DskipTests-Dtar#编译过程不会太长，但是下载各种依赖会比较费时间，耐心等待！#过程中可能会出现各种各样的问题，我只是列出了我花了很长时间才解决的问题如果不能解决问题可以留言经过漫长的编译，终于出现了激动人心的画面[INFO]ReactorSummaryforApacheHadoopMain2.9.2：[INFO][INFO]ApacheHadoopMain..........................成功[1.679s][信息]ApacheHadoop构建工具......................成功[1.158秒][信息]ApacheHadoop项目POM.....................成功[1.071秒][信息]ApacheHadoop注释...............................成功[2.897s][信息]ApacheHadoop程序集...............................成功[0.297秒][信息]ApacheHadoop项目DistPOM.............成功[1.699秒][信息]ApacheHadoopMaven插件......成功[4.280s][信息]ApacheHadoopMiniKDC........................成功[2.940秒][信息]ApacheHadoop身份验证...............................................成功[4.245秒][信息]ApacheHadoop身份验证示例...............成功[2.548秒][信息]ApacheHadoopCommon........................成功[01:05分钟][信息]ApacheHadoopNFS................................成功[3.707s][INFO]ApacheHadoopKMS...........................成功[9.596s][信息]ApacheHadoop公共项目.........................成功[0.046秒][信息]ApacheHadoopHDFS客户端..........................成功[18.270s][信息]ApacheHadoopHDFS.....................成功[46.683s][INFO]ApacheHadoopHDFSNativeClient.....................成功[7.154s][INFO]ApacheHadoopHttpFS.........................成功[14.156s][信息]ApacheHadoopHDFSBookKeeper日志.....................成功[3.215秒][信息]ApacheHadoopHDFS-NFS.....................成功[2.857秒][信息]ApacheHadoopHDFS-RBF.....................成功[13.849s][INFO]ApacheHadoopHDFS项目.............成功[0.100秒][信息]ApacheHadoop纱........................................成功[0.073秒][信息]ApacheHadoopYARNAPI.....................成功[10.318s][INFO]ApacheHadoopYARNCommon.........................成功[23.624s][信息]ApacheHadoopYARN注册表........................成功[3.413秒][信息]ApacheHadoopYARN服务器................................成功[0.091秒][信息]]ApacheHadoopYARN服务器通用......................成功[8.550秒][信息]ApacheHadoopYARNNodeManager..............................成功[26.322秒][信息]ApacheHadoopYARNWeb代理.....................成功[2.491秒][INFO]ApacheHadoopYARNApplicationHistoryService......SUCCESS[4.873s][INFO]ApacheHadoopYARNTimelineService.....................SUCCESS[3.360s][INFO]ApacheHadoopYARNResourceManager.....................成功[16.652s][INFO]ApacheHadoopYARN服务器测试..............................成功[0.993s][信息]ApacheHadoopYARN客户端.....................成功[4.276s][信息]ApacheHadoopYARNSharedCacheManager................成功[2.371s][信息]ApacheHadoopYARN时间线插件存储.........成功[2.464s][信息]ApacheHadoopYARN路由器...................成功[3.747秒][信息]ApacheHadoopYARNTimelineServiceHBase后端......成功[5.310秒][信息]]ApacheHadoopYARN时间线服务HBase测试....成功[1.894s][信息]ApacheHadoopYARN应用程序.....................成功[0.053s][INFO]ApacheHadoopYARNDistributedShell.....................SUCCESS[2.099s][INFO]ApacheHadoopYARNUnmanagedAmLauncher.....................SUCCESS[1.366秒]s][INFO]ApacheHadoopYARN站点.....................成功[0.061s][INFO]ApacheHadoopYARNUI。.........................成功[0.098s][信息]ApacheHadoopYARN项目..................成功[7.639s][信息]ApacheHadoopMapReduce客户端.....................成功[0.157秒][信息]ApacheHadoopMapReduce核心...............................成功[15.248秒][信息]ApacheHadoopMapReduceCommon.....................成功[9.780秒][INFO]ApacheHadoopMapReduceShuffle.....................成功[2.561s][INFO]ApacheHadoopMapReduceApp..............................成功[8.028s][信息]ApacheHadoopMapReduceHistoryServer.....................成功[4.123s][信息]ApacheHadoopMapReduceJobClient.....................成功[4.353s][INFO]ApacheHadoopMapReduceHistoryServer插件......成功[1.349s][INFO]ApacheHadoopMapReduce示例......................成功[3.550s][信息]ApacheHadoopMapReduce..............................成功[3.609秒][信息]ApacheHadoopMapReduce流.....................成功[2.987秒][信息]ApacheHadoop分布式复制......................成功[3.530s][信息]ApacheHadoop档案........................................成功[1.456s][信息]ApacheHadoop存档日志.................................成功[1.654秒][信息]ApacheHadoopRumen.....................成功[3.363秒][信息]]ApacheHadoopGridmix.....................成功[2.833s][信息]ApacheHadoop数据加入.......................成功[1.550秒][信息]ApacheHadoopAnt任务..............................成功[1.378s][信息]ApacheHadoopExtras.....................……成功[2.101s][信息]ApacheHadoop管道................................成功[6.900s][INFO]ApacheHadoopOpenStack支持......................成功[2.804s][INFO]ApacheHadoopAmazonWebServices支持...........成功[7.562秒][信息]ApacheHadoopAzure支持......................成功[4.022秒][信息]ApacheHadoopAliyunOSS支持......................SUCCESS[9.670s][INFO]ApacheHadoopClient..............................成功[5.619秒][信息]ApacheHadoop迷你集群.........................成功[0.638s][INFO]ApacheHadoop调度程序负载模拟器.....................成功[4.075s][INFO]ApacheHadoop资源估算器服务......成功[10.540s][INFO]ApacheHadoopAzureDataLake支持......................成功[12.875s][INFO]ApacheHadoopToolsDist........................................成功[14.670秒][信息]ApacheHadoop工具.........................................成功[0.058秒][信息]ApacheHadoop分发.....................成功[01:02分钟][INFO]ApacheHadoop云存储......................成功[0.473s][INFO]ApacheHadoop云存储项目....................成功[0.042秒][信息]----------------------------------------------------------------------[信息]构建成功[信息]-------------------------------------------------------------------[信息]总时间：09:17分钟[信息]完成时间：2019-05-06T05:03:29-07:00[信息]------------------------------------------------------------------------MacBookPro:hadoop-2.9.2-srcleone$大功告成。编译好的hadoop放在hadoop-2.9.2-src\hadoop-dist\target目录下
