1.下載spark1.4源碼包:spark-1.4.0.tgz
2.解壓,修改make-distribution.sh文件
VERSION=1.4.0
SCALA_VERSION=2.10.4
SPARK_HADOOP_VERSION=2.5.0-cdh5.3.6
SPARK_HIVE=1
# VERSION=$("$MVN" help:evaluate -Dexpression=project.version $@ 2>/dev/null | grep -v "INFO" | tail -n 1)
# SCALA_VERSION=$("$MVN" help:evaluate -Dexpression=scala.binary.version $@ 2>/dev/null\
# | grep -v "INFO"\
# | tail -n 1)
#SPARK_HADOOP_VERSION=$("$MVN" help:evaluate -Dexpression=hadoop.version $@ 2>/dev/null\
# | grep -v "INFO"\
# | tail -n 1)
#SPARK_HIVE=$("$MVN" help:evaluate -Dexpression=project.activeProfiles -pl sql/hive $@ 2>/dev/null\
# | grep -v "INFO"\
# | fgrep --count "<id>hive</id>";\
# Reset exit status to 0, otherwise the script stops here if the last grep finds nothing\
# because we use "set -o pipefail"
# echo -n)
3.編譯,腳本如下:
./make-distribution.sh --tgz \
-Phadoop-2.4 -Dhadoop.version=2.5.0-cdh5.3.6 \
-Pyarn \
-Phive-0.13.1 -Phive-thriftserver
我的編譯成功了,分享以下下載地址吧,spark-1.4.0-bin-2.5.0-cdh5.3.6.tgz,密碼:8kos