完成:
1、Wordcount程序開發環境搭建,eclipse+intellj idea
2、wordcount程序開發,本地單機運行,出統計結果
3、結合源碼追蹤Wordcount中RDD數據流,並作出簡單圖示
遺留問題:
1、intelligent idea環境中運行報錯Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;
at org.apache.spark.util.Utils$.getCallSite(Utils.scala:1434)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:76)
at firstTest$.main(firstTest.scala:11)
at firstTest.main(firstTest.scala)