[main] [INFO] [2021-04-09 13:52:41] Running Spark version 2.4.6
[main] [INFO] [2021-04-09 13:52:41] Submitted application: com.huangyueran.spark.utils.SparkUtils
[main] [INFO] [2021-04-09 13:52:41] Changing view acls to: Zengmin.Zhang
[main] [INFO] [2021-04-09 13:52:41] Changing modify acls to: Zengmin.Zhang
[main] [INFO] [2021-04-09 13:52:41] Changing view acls groups to:
[main] [INFO] [2021-04-09 13:52:41] Changing modify acls groups to:
[main] [INFO] [2021-04-09 13:52:41] SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(Zengmin.Zhang); groups with view permissions: Set(); users with modify permissions: Set(Zengmin.Zhang); groups with modify permissions: Set()
[main] [INFO] [2021-04-09 13:52:42] Successfully started service 'sparkDriver' on port 56791.
[main] [INFO] [2021-04-09 13:52:42] Registering MapOutputTracker
[main] [INFO] [2021-04-09 13:52:42] Registering BlockManagerMaster
[main] [INFO] [2021-04-09 13:52:42] Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
[main] [INFO] [2021-04-09 13:52:42] BlockManagerMasterEndpoint up
[main] [INFO] [2021-04-09 13:52:43] Created local directory at C:\Users\zengming.zhang\AppData\Local\Temp\blockmgr-e68d336a-13ea-419e-9ea1-9b118112f1c8
[main] [INFO] [2021-04-09 13:52:43] MemoryStore started with capacity 1440.3 MB
[main] [INFO] [2021-04-09 13:52:43] Registering OutputCommitCoordinator
[main] [INFO] [2021-04-09 13:52:43] Logging initialized @4304ms
[main] [INFO] [2021-04-09 13:52:43] jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
[main] [INFO] [2021-04-09 13:52:43] Started @4406ms
[main] [INFO] [2021-04-09 13:52:43] Started ServerConnector@6ea1bcdc{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
[main] [INFO] [2021-04-09 13:52:43] Successfully started service 'SparkUI' on port 4040.
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@7a138fc5{/jobs,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@2187fff7{/jobs/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@2e5c7f0b{/jobs/job,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@4de025bf{/jobs/job/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@538613b3{/stages,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@1eef9aef{/stages/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@11389053{/stages/stage,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@5c1bd44c{/stages/stage/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@9f46d94{/stages/pool,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@18cc679e{/stages/pool/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@2e77b8cf{/storage,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@2c4ca0f9{/storage/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@67ef029{/storage/rdd,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@7df587ef{/storage/rdd/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@6e57e95e{/environment,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@2755d705{/environment/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@56db847e{/executors,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@740abb5{/executors/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@560cbf1a{/executors/threadDump,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@5fe8b721{/executors/threadDump/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@551a20d6{/static,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@27e0f2f5{/,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@3574e198{/api,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@3f093abe{/jobs/job/kill,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@61a002b1{/stages/stage/kill,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:43] Bound SparkUI to 0.0.0.0, and started at http://SHAOFFLAP266.dashbrands.local:4040
[main] [INFO] [2021-04-09 13:52:43] Starting executor ID driver on host localhost
[main] [INFO] [2021-04-09 13:52:43] Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 56802.
[main] [INFO] [2021-04-09 13:52:43] Server created on SHAOFFLAP266.dashbrands.local:56802
[main] [INFO] [2021-04-09 13:52:43] Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
[main] [INFO] [2021-04-09 13:52:43] Registering BlockManager BlockManagerId(driver, SHAOFFLAP266.dashbrands.local, 56802, None)
[dispatcher-event-loop-0] [INFO] [2021-04-09 13:52:43] Registering block manager SHAOFFLAP266.dashbrands.local:56802 with 1440.3 MB RAM, BlockManagerId(driver, SHAOFFLAP266.dashbrands.local, 56802, None)
[main] [INFO] [2021-04-09 13:52:43] Registered BlockManager BlockManagerId(driver, SHAOFFLAP266.dashbrands.local, 56802, None)
[main] [INFO] [2021-04-09 13:52:43] Initialized BlockManager: BlockManagerId(driver, SHAOFFLAP266.dashbrands.local, 56802, None)
[main] [INFO] [2021-04-09 13:52:43] Started o.s.j.s.ServletContextHandler@7e0b9178{/metrics/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:44] loading hive config file: file:/C:/eclipse-workspace/SparkDemo/target/classes/hive-site.xml
[main] [INFO] [2021-04-09 13:52:44] spark.sql.warehouse.dir is not set, but hive.metastore.warehouse.dir is set. Setting spark.sql.warehouse.dir to the value of hive.metastore.warehouse.dir ('/user/hive/warehouse/').
[main] [INFO] [2021-04-09 13:52:44] Warehouse path is '/user/hive/warehouse/'.
[main] [INFO] [2021-04-09 13:52:44] Started o.s.j.s.ServletContextHandler@6a714237{/SQL,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:44] Started o.s.j.s.ServletContextHandler@3e134896{/SQL/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:44] Started o.s.j.s.ServletContextHandler@6ac97b84{/SQL/execution,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:44] Started o.s.j.s.ServletContextHandler@4917d36b{/SQL/execution/json,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:44] Started o.s.j.s.ServletContextHandler@4a699efa{/static/sql,null,AVAILABLE,@Spark}
[main] [INFO] [2021-04-09 13:52:45] Registered StateStoreCoordinator endpoint
[main] [INFO] [2021-04-09 13:52:45] Initializing HiveMetastoreConnection version 1.2.1 using Spark classes.
[main] [INFO] [2021-04-09 13:52:46] Trying to connect to metastore with URI thrift://udp01:9083
[main] [INFO] [2021-04-09 13:52:46] Connected to metastore.
[main] [INFO] [2021-04-09 13:53:20] Created local directory: C:/Users/ZENGMI~1.ZHA/AppData/Local/Temp/cca11151-7ed8-412e-b2c2-852e03030022_resources
[main] [INFO] [2021-04-09 13:53:20] Created HDFS directory: /tmp/hive/Zengmin.Zhang/cca11151-7ed8-412e-b2c2-852e03030022
[main] [INFO] [2021-04-09 13:53:20] Created local directory: C:/Users/ZENGMI~1.ZHA/AppData/Local/Temp/Zengmin.Zhang/cca11151-7ed8-412e-b2c2-852e03030022
[main] [INFO] [2021-04-09 13:53:20] Created HDFS directory: /tmp/hive/Zengmin.Zhang/cca11151-7ed8-412e-b2c2-852e03030022/_tmp_space.db
Exception in thread "main" java.lang.ClassNotFoundException: java.lang.NoClassDefFoundError: org/apache/tez/dag/api/SessionNotRunning when creating Hive client using classpath: file:/C:/eclipse-workspace/SparkDemo/target/classes/, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/scala-library/2.12.13/scala-library-2.12.13.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-core_2.12/2.4.6/spark-core_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/commons/commons-compress/1.8.1/commons-compress-1.8.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/twitter/chill_2.12/0.9.3/chill_2.12-0.9.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/twitter/chill-java/0.9.3/chill-java-0.9.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/xbean/xbean-asm6-shaded/4.8/xbean-asm6-shaded-4.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-client/2.6.5/hadoop-client-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-common/2.6.5/hadoop-common-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-auth/2.6.5/hadoop-auth-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/htrace/htrace-core/3.0.4/htrace-core-3.0.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.6.5/hadoop-hdfs-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar, file:/C:/Users/zengming.zhang/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.6.5/hadoop-mapreduce-client-app-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.6.5/hadoop-mapreduce-client-common-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.6.5/hadoop-yarn-client-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.6.5/hadoop-yarn-server-common-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.6.5/hadoop-mapreduce-client-shuffle-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.6.5/hadoop-yarn-api-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.6.5/hadoop-mapreduce-client-core-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.6.5/hadoop-yarn-common-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.6.5/hadoop-mapreduce-client-jobclient-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/hadoop/hadoop-annotations/2.6.5/hadoop-annotations-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-launcher_2.12/2.4.6/spark-launcher_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-kvstore_2.12/2.4.6/spark-kvstore_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.6.7/jackson-annotations-2.6.7.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-network-common_2.12/2.4.6/spark-network-common_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-network-shuffle_2.12/2.4.6/spark-network-shuffle_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-unsafe_2.12/2.4.6/spark-unsafe_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/slf4j/jul-to-slf4j/1.7.16/jul-to-slf4j-1.7.16.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.16/jcl-over-slf4j-1.7.16.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/xerial/snappy/snappy-java/1.1.7.5/snappy-java-1.1.7.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/lz4/lz4-java/1.4.0/lz4-java-1.4.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/github/luben/zstd-jni/1.3.2-2/zstd-jni-1.3.2-2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-jackson_2.12/3.5.3/json4s-jackson_2.12-3.5.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-core_2.12/3.5.3/json4s-core_2.12-3.5.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-ast_2.12/3.5.3/json4s-ast_2.12-3.5.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-scalap_2.12/3.5.3/json4s-scalap_2.12-3.5.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/core/jersey-client/2.22.2/jersey-client-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/ws/rs/javax.ws.rs-api/2.0.1/javax.ws.rs-api-2.0.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/hk2/hk2-api/2.4.0-b34/hk2-api-2.4.0-b34.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/hk2/hk2-utils/2.4.0-b34/hk2-utils-2.4.0-b34.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.4.0-b34/aopalliance-repackaged-2.4.0-b34.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/hk2/hk2-locator/2.4.0-b34/hk2-locator-2.4.0-b34.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/core/jersey-common/2.22.2/jersey-common-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/bundles/repackaged/jersey-guava/2.22.2/jersey-guava-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/core/jersey-server/2.22.2/jersey-server-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.22.2/jersey-media-jaxb-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/validation/validation-api/1.1.0.Final/validation-api-1.1.0.Final.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.22.2/jersey-container-servlet-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.22.2/jersey-container-servlet-core-2.22.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/netty/netty/3.9.9.Final/netty-3.9.9.Final.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/dropwizard/metrics/metrics-core/3.1.5/metrics-core-3.1.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/dropwizard/metrics/metrics-jvm/3.1.5/metrics-jvm-3.1.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/dropwizard/metrics/metrics-json/3.1.5/metrics-json-3.1.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/dropwizard/metrics/metrics-graphite/3.1.5/metrics-graphite-3.1.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.6.7.3/jackson-databind-2.6.7.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.6.7.1/jackson-module-scala_2.12-2.6.7.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.7.9/jackson-module-paranamer-2.7.9.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/razorvine/pyrolite/4.13/pyrolite-4.13.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/sf/py4j/py4j/0.10.7/py4j-0.10.7.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-tags_2.12/2.4.6/spark-tags_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/commons/commons-crypto/1.0.0/commons-crypto-1.0.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-mllib_2.12/2.4.6/spark-mllib_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.12/1.1.0/scala-parser-combinators_2.12-1.1.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-sql_2.12/2.4.6/spark-sql_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/univocity/univocity-parsers/2.7.3/univocity-parsers-2.7.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-sketch_2.12/2.4.6/spark-sketch_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-catalyst_2.12/2.4.6/spark-catalyst_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/codehaus/janino/janino/3.0.16/janino-3.0.16.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/codehaus/janino/commons-compiler/3.0.16/commons-compiler-3.0.16.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/antlr/antlr4-runtime/4.7/antlr4-runtime-4.7.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/orc/orc-core/1.5.5/orc-core-1.5.5-nohive.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/orc/orc-shims/1.5.5/orc-shims-1.5.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/airlift/aircompressor/0.10/aircompressor-0.10.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/orc/orc-mapreduce/1.5.5/orc-mapreduce-1.5.5-nohive.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/parquet/parquet-column/1.10.1/parquet-column-1.10.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/parquet/parquet-common/1.10.1/parquet-common-1.10.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/parquet/parquet-encoding/1.10.1/parquet-encoding-1.10.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/parquet/parquet-hadoop/1.10.1/parquet-hadoop-1.10.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/parquet/parquet-format/2.4.0/parquet-format-2.4.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/parquet/parquet-jackson/1.10.1/parquet-jackson-1.10.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/arrow/arrow-vector/0.10.0/arrow-vector-0.10.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/arrow/arrow-format/0.10.0/arrow-format-0.10.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/arrow/arrow-memory/0.10.0/arrow-memory-0.10.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/carrotsearch/hppc/0.7.2/hppc-0.7.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/vlkan/flatbuffers/1.2.0-3f79e055/flatbuffers-1.2.0-3f79e055.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-graphx_2.12/2.4.6/spark-graphx_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/github/fommil/netlib/core/1.1.2/core-1.1.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-mllib-local_2.12/2.4.6/spark-mllib-local_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scalanlp/breeze_2.12/0.13.2/breeze_2.12-0.13.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scalanlp/breeze-macros_2.12/0.13.2/breeze-macros_2.12-0.13.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/github/rwl/jtransforms/2.4.0/jtransforms-2.4.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spire-math/spire_2.12/0.13.0/spire_2.12-0.13.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spire-math/spire-macros_2.12/0.13.0/spire-macros_2.12-0.13.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/typelevel/machinist_2.12/0.6.1/machinist_2.12-0.6.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/chuusai/shapeless_2.12/2.3.2/shapeless_2.12-2.3.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/typelevel/macro-compat_2.12/1.1.1/macro-compat_2.12-1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-streaming_2.12/2.4.6/spark-streaming_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-streaming-kafka_2.11/1.6.3/spark-streaming-kafka_2.11-1.6.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/kafka/kafka_2.11/0.8.2.1/kafka_2.11-0.8.2.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/modules/scala-xml_2.11/1.0.2/scala-xml_2.11-1.0.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.2/scala-parser-combinators_2.11-1.0.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/101tec/zkclient/0.3/zkclient-0.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/spark/spark-hive_2.12/2.4.6/spark-hive_2.12-2.4.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/twitter/parquet-hadoop-bundle/1.6.0/parquet-hadoop-bundle-1.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spark-project/hive/hive-exec/1.2.1.spark2/hive-exec-1.2.1.spark2.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/javolution/javolution/5.5.1/javolution-5.5.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/log4j/apache-log4j-extras/1.2.17/apache-log4j-extras-1.2.17.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/antlr/antlr-runtime/3.4/antlr-runtime-3.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/antlr/stringtemplate/3.2.1/stringtemplate-3.2.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/antlr/antlr/2.7.7/antlr-2.7.7.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/antlr/ST4/4.0.4/ST4-4.0.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/googlecode/javaewah/JavaEWAH/0.3.2/JavaEWAH-0.3.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/iq80/snappy/snappy/0.2/snappy-0.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spark-project/hive/hive-metastore/1.2.1.spark2/hive-metastore-1.2.1.spark2.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/jolbox/bonecp/0.8.0.RELEASE/bonecp-0.8.0.RELEASE.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/datanucleus/datanucleus-api-jdo/3.2.6/datanucleus-api-jdo-3.2.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/datanucleus/datanucleus-rdbms/3.2.9/datanucleus-rdbms-3.2.9.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-pool/commons-pool/1.5.4/commons-pool-1.5.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-dbcp/commons-dbcp/1.4/commons-dbcp-1.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/jdo/jdo-api/3.0.1/jdo-api-3.0.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/transaction/jta/1.1/jta-1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/calcite/calcite-avatica/1.2.0-incubating/calcite-avatica-1.2.0-incubating.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/calcite/calcite-core/1.2.0-incubating/calcite-core-1.2.0-incubating.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/calcite/calcite-linq4j/1.2.0-incubating/calcite-linq4j-1.2.0-incubating.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/hydromatic/eigenbase-properties/1.1.5/eigenbase-properties-1.1.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/httpcomponents/httpcore/4.4.10/httpcore-4.4.10.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar, file:/C:/Users/zengming.zhang/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar, file:/C:/Users/zengming.zhang/.m2/repository/joda-time/joda-time/2.9.3/joda-time-2.9.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/jodd/jodd-core/3.5.2/jodd-core-3.5.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/datanucleus/datanucleus-core/3.2.10/datanucleus-core-3.2.10.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/thrift/libthrift/0.9.3/libthrift-0.9.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/thrift/libfb303/0.9.3/libfb303-0.9.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/derby/derby/10.12.1.1/derby-10.12.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-examples_2.11/2.1.1.1/snappy-spark-examples_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-core_2.11/2.1.1.1/snappy-spark-core_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-servlets/9.2.22.v20170606/jetty-servlets-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-io/9.2.22.v20170606/jetty-io-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/twitter/chill_2.11/0.8.1/chill_2.11-0.8.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/java/dev/jets3t/jets3t/0.9.3/jets3t-0.9.3.jar, file:/C:/Users/zengming.zhang/.m2/repository/mx4j/mx4j/3.0.2/mx4j-3.0.2.jar, file:/C:/Users/zengming.zhang/.m2/repository/javax/mail/mail/1.4.7/mail-1.4.7.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/bouncycastle/bcprov-jdk15on/1.51/bcprov-jdk15on-1.51.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/1.0/java-xmlbuilder-1.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/iharder/base64/2.3.8/base64-2.3.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-http/9.2.22.v20170606/jetty-http-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/xbean/xbean-asm5-shaded/4.4/xbean-asm5-shaded-4.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-tags_2.11/2.1.1.1/snappy-spark-tags_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-network-shuffle_2.11/2.1.1.1/snappy-spark-network-shuffle_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/scalap/2.11.8/scalap-2.11.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/scala-compiler/2.11.8/scala-compiler-2.11.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-client/9.2.22.v20170606/jetty-client-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-unsafe_2.11/2.1.1.1/snappy-spark-unsafe_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-continuation/9.2.22.v20170606/jetty-continuation-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-security/9.2.22.v20170606/jetty-security-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-launcher_2.11/2.1.1.1/snappy-spark-launcher_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-servlet/9.2.22.v20170606/jetty-servlet-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-util/9.2.22.v20170606/jetty-util-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.11/2.6.5/jackson-module-scala_2.11-2.6.5.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-proxy/9.2.22.v20170606/jetty-proxy-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-server/9.2.22.v20170606/jetty-server-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-plus/9.2.22.v20170606/jetty-plus-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-webapp/9.2.22.v20170606/jetty-webapp-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-xml/9.2.22.v20170606/jetty-xml-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/eclipse/jetty/jetty-jndi/9.2.22.v20170606/jetty-jndi-9.2.22.v20170606.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-network-common_2.11/2.1.1.1/snappy-spark-network-common_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/google/protobuf/protobuf-java/2.6.1/protobuf-java-2.6.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-jackson_2.11/3.2.11/json4s-jackson_2.11-3.2.11.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-core_2.11/3.2.11/json4s-core_2.11-3.2.11.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/json4s/json4s-ast_2.11/3.2.11/json4s-ast_2.11-3.2.11.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-streaming-flume_2.11/2.1.1.1/snappy-spark-streaming-flume_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/flume/flume-ng-sdk/1.6.0/flume-ng-sdk-1.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-streaming-flume-sink_2.11/2.1.1.1/snappy-spark-streaming-flume-sink_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/flume/flume-ng-core/1.6.0/flume-ng-core-1.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/flume/flume-ng-configuration/1.6.0/flume-ng-configuration-1.6.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20110124/servlet-api-2.5-20110124.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/apache/mina/mina-core/2.0.4/mina-core-2.0.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-mllib_2.11/2.1.1.1/snappy-spark-mllib_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-sql_2.11/2.1.1.1/snappy-spark-sql_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-sketch_2.11/2.1.1.1/snappy-spark-sketch_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-catalyst_2.11/2.1.1.1/snappy-spark-catalyst_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-mllib-local_2.11/2.1.1.1/snappy-spark-mllib-local_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scalanlp/breeze_2.11/0.12/breeze_2.11-0.12.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scalanlp/breeze-macros_2.11/0.12/breeze-macros_2.11-0.12.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spire-math/spire_2.11/0.7.4/spire_2.11-0.7.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/spire-math/spire-macros_2.11/0.7.4/spire-macros_2.11-0.7.4.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/chuusai/shapeless_2.11/2.0.0/shapeless_2.11-2.0.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/jpmml/pmml-model/1.2.15/pmml-model-1.2.15.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/jpmml/pmml-schema/1.2.15/pmml-schema-1.2.15.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/scala-lang/scala-reflect/2.11.8/scala-reflect-2.11.8.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-streaming_2.11/2.1.1.1/snappy-spark-streaming_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-streaming-kafka-0.8_2.11/2.1.1.1/snappy-spark-streaming-kafka-0.8_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-graphx_2.11/2.1.1.1/snappy-spark-graphx_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/com/github/scopt/scopt_2.11/3.3.0/scopt_2.11-3.3.0.jar, file:/C:/Users/zengming.zhang/.m2/repository/io/snappydata/snappy-spark-hive_2.11/2.1.1.1/snappy-spark-hive_2.11-2.1.1.1.jar, file:/C:/Users/zengming.zhang/.m2/repository/mysql/mysql-connector-java/5.1.40/mysql-connector-java-5.1.40.jar, file:/C:/Users/zengming.zhang/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/slf4j/slf4j-api/1.7.12/slf4j-api-1.7.12.jar, file:/C:/Users/zengming.zhang/.m2/repository/org/slf4j/slf4j-log4j12/1.7.12/slf4j-log4j12-1.7.12.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/access-bridge-64.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/cldrdata.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/dnsns.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/jaccess.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/jfxrt.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/localedata.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/nashorn.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/sunec.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/sunjce_provider.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/sunmscapi.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/sunpkcs11.jar, file:/C:/Program%20Files/Java/jdk1.8.0_191/jre/lib/ext/zipfs.jar
Please make sure that jars for your version of hive and hadoop are included in the paths passed to spark.sql.hive.metastore.jars.
at org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:280)
at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:384)
at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:286)
at org.apache.spark.sql.hive.HiveExternalCatalog.client$lzycompute(HiveExternalCatalog.scala:66)
at org.apache.spark.sql.hive.HiveExternalCatalog.client(HiveExternalCatalog.scala:65)
at org.apache.spark.sql.hive.HiveExternalCatalog.$anonfun$databaseExists$1(HiveExternalCatalog.scala:215)
at scala.runtime.java8.JFunction0$mcZ$sp.apply(JFunction0$mcZ$sp.java:23)
at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:97)
at org.apache.spark.sql.hive.HiveExternalCatalog.databaseExists(HiveExternalCatalog.scala:215)
at org.apache.spark.sql.internal.SharedState.externalCatalog$lzycompute(SharedState.scala:116)
at org.apache.spark.sql.internal.SharedState.externalCatalog(SharedState.scala:104)
at org.apache.spark.sql.internal.SharedState.globalTempViewManager$lzycompute(SharedState.scala:143)
at org.apache.spark.sql.internal.SharedState.globalTempViewManager(SharedState.scala:138)
at org.apache.spark.sql.hive.HiveSessionStateBuilder.$anonfun$catalog$2(HiveSessionStateBuilder.scala:55)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.globalTempViewManager$lzycompute(SessionCatalog.scala:91)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.globalTempViewManager(SessionCatalog.scala:91)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.isTemporaryTable(SessionCatalog.scala:736)
at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$.isRunningDirectlyOnFiles(Analyzer.scala:814)
at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$.resolveRelation(Analyzer.scala:748)
at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$$anonfun$apply$6.applyOrElse(Analyzer.scala:780)
at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$$anonfun$apply$6.applyOrElse(Analyzer.scala:773)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$3(AnalysisHelper.scala:90)
at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:69)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$1(AnalysisHelper.scala:90)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:194)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp(AnalysisHelper.scala:86)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp$(AnalysisHelper.scala:84)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUp(LogicalPlan.scala:29)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$2(AnalysisHelper.scala:87)
at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$mapChildren$1(TreeNode.scala:328)
at org.apache.spark.sql.catalyst.trees.TreeNode.mapProductIterator(TreeNode.scala:186)
at org.apache.spark.sql.catalyst.trees.TreeNode.mapChildren(TreeNode.scala:326)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$1(AnalysisHelper.scala:87)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:194)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp(AnalysisHelper.scala:86)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp$(AnalysisHelper.scala:84)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUp(LogicalPlan.scala:29)
at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$.apply(Analyzer.scala:773)
at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$.apply(Analyzer.scala:719)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$2(RuleExecutor.scala:87)
at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126)
at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122)
at scala.collection.immutable.List.foldLeft(List.scala:91)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:84)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1$adapted(RuleExecutor.scala:76)
at scala.collection.immutable.List.foreach(List.scala:431)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:76)
at org.apache.spark.sql.catalyst.analysis.Analyzer.org$apache$spark$sql$catalyst$analysis$Analyzer$$executeSameContext(Analyzer.scala:127)
at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:121)
at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$executeAndCheck$1(Analyzer.scala:106)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.markInAnalyzer(AnalysisHelper.scala:201)
at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:105)
at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:58)
at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:56)
at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:48)
at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:78)
at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:643)
at my.test.JavaSparkHiveExample2.main(JavaSparkHiveExample2.java:70)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:271)
... 57 more
Caused by: java.lang.NoClassDefFoundError: org/apache/tez/dag/api/SessionNotRunning
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:529)
at org.apache.spark.sql.hive.client.HiveClientImpl.newState(HiveClientImpl.scala:185)
at org.apache.spark.sql.hive.client.HiveClientImpl.<init>(HiveClientImpl.scala:118)
... 62 more
Caused by: java.lang.ClassNotFoundException: org.apache.tez.dag.api.SessionNotRunning
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.doLoadClass(IsolatedClientLoader.scala:226)
at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.loadClass(IsolatedClientLoader.scala:215)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 65 more
[Thread-1] [INFO] [2021-04-09 13:53:20] Invoking stop() from shutdown hook
[Thread-1] [INFO] [2021-04-09 13:53:20] Stopped Spark@6ea1bcdc{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
[Thread-1] [INFO] [2021-04-09 13:53:20] Stopped Spark web UI at http://SHAOFFLAP266.dashbrands.local:4040
[dispatcher-event-loop-1] [INFO] [2021-04-09 13:53:21] MapOutputTrackerMasterEndpoint stopped!
[Thread-1] [INFO] [2021-04-09 13:53:21] MemoryStore cleared
[Thread-1] [INFO] [2021-04-09 13:53:21] BlockManager stopped
[Thread-1] [INFO] [2021-04-09 13:53:21] BlockManagerMaster stopped
[dispatcher-event-loop-0] [INFO] [2021-04-09 13:53:21] OutputCommitCoordinator stopped!
[Thread-1] [INFO] [2021-04-09 13:53:21] Successfully stopped SparkContext
[Thread-1] [INFO] [2021-04-09 13:53:21] Shutdown hook called
[Thread-1] [INFO] [2021-04-09 13:53:21] Deleting directory C:\Users\zengming.zhang\AppData\Local\Temp\spark-15f81968-e061-416b-bdc5-680d6b635d3b
解決方案：
