因為Apache hadoop 只提供了32位的包，所以需要自己編譯64位的包，下面是編譯步驟

所需要的包

6：java 1.7+

下面是具體安裝：

1：Java安裝

安裝之前請卸載系統自帶的jdk,openjdk

export M3_HOME=/home/data/app/apache-maven-3.3.9

export FINDBUGS_HOME=/home/data/app/findbugs-1.3.9

export ANT_HOME=/home/data/app/apache-ant-1.9.7

export CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

export PATH=$PATH:$JAVA_HOME/bin:$M3_HOME/bin:$FINDBUGS_HOME/bin:$ANT_HOME/bin(這個是我已經安裝好的，可以自行刪減)

5. java -version 查看java是否安裝成功

2：apache-ant-1.9.7-bin.tar.gz 安裝

1.tar -zxvf apache-ant-1.9.7-bin.tar.gz 解壓

2.vi /etc/profile 添加ant環境變量(因為上一步我已經添加了所以這里就不用加了)

3.ant -version

3：apache-maven-3.3.9-bin.tar.gz 安裝

1.tar -zxvf apache-maven-3.3.9-bin.tar.gz 解壓

2.vi /etc/profile 添加ant環境變量(因為上一步我已經添加了所以這里就不用加了)

3.mvn -version

4：findbugs-1.3.9.tar.gz 安裝

1.tar -zxvf findbugs-1.3.9.tar.gz

2.vi /etc/profile 添加ant環境變量(因為上一步我已經添加了所以這里就不用加了)

3.findbugs -version

5：protobuf-2.5.0.tar.gz 安裝

1.tar -zxvf protobuf-2.5.0.tar.gz 解壓

2.cd protobuf-2.5.0

3. ./configure

4. make install(如果make 沒有安裝，請執行yum -y install autoconf automake libtool cmake ncurses-devel openssl-devel lzo-devel zlib-devel gcc gcc-c++)

5.vi /etc/profile 添加ant環境變量(因為上一步我已經添加了所以這里就不用加了)

6：hadoop-2.7.1-src.tar.gz 編譯

1.tar -zxvf hadoop-2.7.1-src.tar.gz 解壓

2.mvn package -Pdist,native -DskipTests -Dtar

編譯完成后的bin版本在目錄 hadoop-dist下

編譯過程中可能出現的錯誤

[ERROR] Failed to execute goal on project hadoop-common: Could not resolve dependencies for project org.apache.hadoop:hadoop-common:jar:2.7.1: Could not transfer artifact org.apache.commons:commons-math3:jar:3.1.1 from/to nexus-osc (http://maven.oschina.net/content/groups/public/): GET request of: org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar from nexus-osc failed: Premature end of Content-Length delimited message body (expected: 1599627; received: 866169 -> [Help 1]

[ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:2.7.1:protoc (compile-protoc) on project hadoop-common: org.apache.maven.plugin.MojoExecutionException: ‘protoc?–version’ did not return a version -> [Help 1]

缺這缺那的，用thrift編譯說明提到的一個把開發工具全裝上。

yum -y groupinstall “Development Tools”

需要安裝ant，?yum install ant

Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildException has occured: Execute failed: java.io.IOException: Cannot run program “cmake” (in directory “/root/hadoop-2.7.1-src/hadoop-common-project/hadoop-common/target/native”): error=2, No such file or directory

需要安裝 findbugs

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project hadoop-common: An Ant BuildException has occured: stylesheet /home/hadoop/hadoop-2.7.1-src/hadoop-common-project/hadoop-common/${env.FINDBUGS_HOME}/src/xsl/default.xsl doesn’t exist.

[ERROR] around Ant part …… @ 43:251 in /home/hadoop/hadoop-2.7.1-src/hadoop-common-project/hadoop-common/target/antrun/build-main.xml

然后設置環境變量 ?export FINDBUGS_HOME=/usr/local/findbugs-3.0.0

需要安裝cmake

Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on

project hadoop-pipes: An Ant BuildException has occured: exec returned: 1

[ERROR] around Ant part …

tools/hadoop-pipes/target/native” executable=”cmake” failοnerrοr=”true”>… @ 5:131 in

/home/pory/workplace/hadoop-2.4.1-src/hadoop-tools/hadoop-pipes/target/antrun/build-

main.xml

安裝zlib-dev 和 libssl-dev ，可能在groupinstall已經安裝了。

//kms這個，換個目錄重新編譯或者多試幾次，因為下載tomcat超時導致的問題。

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (dist) on project hadoop-kms: An Ant BuildException has occured: exec returned: 2

[ERROR] around Ant part …… @ 10:120 in /home/hadoop/hadoop-2.7.1-src/hadoop-common-project/hadoop-kms/target/antrun/build-main.xml

[ERROR] -> [Help 1]

總結

以上是生活随笔為你收集整理的linux 编译hadoop,linux centos 安装编译hadoop2.7.1的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。