一個切換JDK後ZINC進程導致Apache Spark編譯失敗的問題

錯誤日誌

[info] Compiling 13 Scala sources and 1 Java source to /srv/nbs/0/ne-spark/ne-spark/external/kafka-0-10-sql/target/scala-2.11/classes...
[error] javac: invalid source release: 1.8
[error] Usage: javac <options> <source files>
[error] use -help for a list of possible options
[error] Compile failed at 2018-5-8 15:01:18 [1.697s]

相關JIRA

https://issues.apache.org/jira/browse/SPARK-21075
不過這玩意都有人提issue，還好committer中有owen大哥，到處頂帖。。不過還是Dongjoon哥穩，一下就看出了啥毛病

popo_2018-05-08 15-23-02.jpg

確認JDK

hadoop@hzadg-jenkins:~/data/ne-spark/ne-spark$ jenv list java
Available java Versions
=========================
   1.8.0_91
 * 1.8.0_77
>* 1.8.0_71
   1.8.0_60
   1.8.0_51
   1.8.0_45
   1.8.0_40
   1.8.0_31
   1.8.0_25
   1.8.0_20
 * 1.8.0_112
   1.8.0_11
   1.8.0_101
   1.8.0_05
   1.8.0
 * 1.7.0_75
   1.7.0_67
   1.7.0_65
   1.7.0_60
   1.7.0_55
   1.7.0_51
   1.7.0_45
   1.7.0_40
   1.7.0_25
   1.6.0_45

當前環境使用的是 >* 1.8.0_71貌似沒啥問題。

看看ZINC

hadoop@hzadg-jenkins:~/data/ne-spark/ne-spark$ ps -ef | grep zinc
hadoop    1346     1  1 May04 ?        01:05:36 /home/hadoop/.jenv/candidates/java/current/bin/java -server -Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m -Dzinc.home=/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9 -classpath /srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/compiler-interface-sources.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/incremental-compiler.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/nailgun-server.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/sbt-interface.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/scala-compiler.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/scala-library.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/scala-reflect.jar:/srv/nbs/0/ne-spark/ne-spark/build/zinc-0.3.9/lib/zinc.jar com.typesafe.zinc.Nailgun 3030 0

果然是早上切了個JDK 1.7.0_75後導致的問題，果斷kill

編譯成功