Ubuntu下编译Hadoop-2.9.2系统环境:ubuntu-18.10-desktop-amd64maven:ApacheMaven3.6.0jdk:jdk_1.8.0_201ProtocolBuffer:portoc-2.5.0OpenSSL:OpenSSL1.1.1cmake:cmake3.12.1hadoop:Hadoop-2.9.2安装所需环境#安装各种需要的依赖库$sudoapt-getinstallautoconfautomakelibtoolzlib1g-devpkg-configlibssl-devlibsnappy-devlibbz2-dev#安装ssh-server$sudoapt-getinstallssh-server#安装openssl$sudoapt-getinstallopenssl#安装cmake$sudoapt-getinstallcmake#安装编译c++库$sudoapt-getinstallg++#安装protobuf#下载protobuf-2.5。0$wgethttps://github.com/protocolbuffers/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz#解压$tar-zxvfprotobuf-2.5.0.tar.gz#进入Protobuf解压目录配置$./configur--prefix=/usr/local/protoc-2.5.0#编译安装$make&&makeinstall#配置到环境变量~/.bash_profileexportPATH="/usr/local/protoc-2.5.0/bin:$PATH"编译过程中可能遇到的问题注意libssl-dev安装换成libssl1.0-dev版本。之前我都是默认安全开关,编译OpenSSL功能的时候,卡主一直编译失败。具体报错形式如下[exec]make[2]:***[CMakeFiles/hadoop_static.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o]Error1[exec]make[1]:***[CMakeFiles/hadoop_static.dir/all]Error2[exec]make:***[all]Error2#Removelibssl-dev$sudoapt-getremotelibssl-dev#安装libssl1.0-dev$sudoapt-getinstalllibssl1.0-dev开始编译hadoop$mvnpackage-Pdist,native-DskipTests-Dtar命令执行完之后需要等他下载编译需要的所有依赖。该过程可能需要很长时间...................成功[0.758秒][信息]ApacheHadoop构建工具...................................................成功[0.426秒][信息]ApacheHadoop项目POM......................................SUCCESS[0.470s][INFO]ApacheHadoopAnnotations.....................................SUCCESS[1.169s][INFO]ApacheHadoopAssemblies............................成功[0.134秒][信息]ApacheHadoop项目DistPOM.........................成功[1.145s][信息]ApacheHadoopMaven插件......................成功[2.224s][信息]ApacheHadoopMiniKDC........................................成功[1.923s][信息]ApacheHadoop身份验证...............................成功[2.653秒][信息]ApacheHadoop身份验证示例.....................成功[1.823秒][INFO]ApacheHadoopCommon.....................成功[40.786s][INFO]ApacheHadoopNFS。...................................成功[2.925秒][信息]ApacheHadoopKMS...............................成功[8.053s][信息]ApacheHadoop公共项目...................................成功[0.050秒][信息]ApacheHadoopHDFS客户端.................................成功[46.997秒][信息]ApacheHadoopHDFS.....................成功[42.883秒][信息]ApacheHadoopHDFS本??机客户端......................成功[5.907s][信息]ApacheHadoopHttpFS........................................成功[11.476s][信息]ApacheHadoopHDFSBookKeeperJournal.....................成功[5.320s][INFO]ApacheHadoopHDFS-NFS..............................成功[2.055秒][信息]ApacheHadoopHDFS-RBF.....................成功[11.390s][INFO]ApacheHadoopHDFS项目......................成功[0.053s][INFO]ApacheHadoopYARN......................成功[0.045秒][信息]ApacheHadoopYARNAPI...............成功[8.620s][信息]ApacheHadoopYARNCommon..............................成功[25.431秒][信息]ApacheHadoopYARN注册表.....................成功[2.577秒][信息]ApacheHadoopYARN服务器......................成功[0.067秒][信息]ApacheHadoopYARN服务器通用.............成功[6.540s][信息]ApacheHadoopYARNNodeManager.....................成功[25.577s][INFO]ApacheHadoopYARNWeb代理......................成功[1.779s][INFO]ApacheHadoopYARNApplicationHistoryService.........成功[11.509s][信息]ApacheHadoopYARN时间线服务......成功[2.671s][信息]ApacheHadoopYARNResourceManager...........成功[12.742s][信息]ApacheHadoopYARN服务器测试.....................成功[0.760s][INFO]ApacheHadoopYARNClient.....................成功[3.285s][INFO]ApacheHadoopYARNSharedCacheManager...........成功[1.976s][信息]ApacheHadoopYARN时间线插件存储.........成功[1.730s][信息]ApacheHadoopYARN路由器...............................成功[2.516秒][信息]ApacheHadoopYARNTimelineServiceHBase后端......成功[23.469秒][信息]ApacheHadoopYARNTimelineServiceHBase测试....成功[1.727s][INFO]ApacheHadoopYARN应用程序......成功[0.037s][INFO]ApacheHadoopYARNDistributedShell...............................SUCCESS[1.611s][INFO]ApacheHadoopYARNUnmanagedAmLauncher.....................SUCCESS[1.039s][INFO]ApacheHadoopYARN站点.....................SUCCESS[0.041s][INFO]ApacheHadoopYARNUI.....................成功[0.027s][INFO]ApacheHadoopYARN项目.........................成功[4.166s][信息]ApacheHadoopMapReduce客户端.....................成功[0.126秒][信息]ApacheHadoopMapReduce核心.....................成功[11.880秒][信息]ApacheHadoopMapReduce通用。.........成功[8.171s][信息]ApacheHadoopMapReduceShuffle.......................成功[1.818秒][信息]ApacheHadoopMapReduce应用.....................成功[4.549秒][信息]ApacheHadoopMapReduceHistoryServer.....................成功[2.999秒][信息]ApacheHadoopMapReduceJobClient.....................成功[3.505秒][信息]ApacheHadoopMapReduceHistoryServer插件......成功[1.104s][信息]ApacheHadoopMapReduce示例......................成功[2.656s][INFO]ApacheHadoopMapReduce.....................成功[2.052s][INFO]ApacheHadoopMapReduceStreaming。.........成功[9.580s][信息]ApacheHadoop分布式副本.....................成功[2.545秒][信息]ApacheHadoop档案.............................成功[1.964秒][信息]ApacheHadoop存档日志......................成功[1.355s][信息]ApacheHadoopRumen..............................成功[2.651s][信息]ApacheHadoopGridmix........................................成功[2.451秒][信息]ApacheHadoop数据加入.................................成功[1.281s][INFO]ApacheHadoopAntTasks.....................SUCCESS[0.910s][INFO]ApacheHadoopExtras.....................成功[1.269s][INFO]ApacheHadoopPipes.........................成功[4.864s][信息]ApacheHadoopOpenStack支持..............................成功[2.166秒][信息]ApacheHadoopAmazonWebServices支持.........成功[17.425s][INFO]ApacheHadoopAzure支持........................SUCCESS[3.589s][INFO]ApacheHadoopAliyunOSSsupport.....................SUCCESS[1.737s][INFO]ApacheHadoopClient.........................成功[4.883秒][信息]ApacheHadoop迷你集群...........................成功[0.535秒][信息]ApacheHadoop调度程序负载模拟器.....................成功[3.363秒][信息]ApacheHadoop资源估算器服务.....................成功[2.404秒][信息]ApacheHadoopAzure数据湖支持.....................成功[1.732秒][信息]ApacheHadoopToolsDist.....................成功[17.061s][INFO]ApacheHadoopTools...............................成功[0.035秒][信息]ApacheHadoop分发..............................成功[42.773秒][信息]ApacheHadoop云存储.....................成功[2.183秒][信息]ApacheHadoop云存储项目......................成功[0.229秒][信息]-------------------------------------------------------------------------[信息]构建成功[信息]---------------------------------------------------------------------[信息]总时间:08:19分钟[信息]完成于:2019-05-08T17:23:30+08:00[信息]-----------------------------------------------------------------------leone@leone-ubuntu:~/下载/hadoop-2.9.2-src$完成后编译好的hadoop放在hadoop-2.9.2-src\hadoop-dist\target目录下
