spark sql 使用過程中 無法識別輸入字段

在使用spark  sql  過程中 可能映射爲實體類 

但是該實體類的屬性 ,並沒有設置getter  setter  方法 就會出現如下問題 

提示 : 無法識別某些字段 

/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/bin/java "-javaagent:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar=59920:/Applications/IntelliJ IDEA.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath /Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/tools.jar:/Users/apple/IdeaProjects/spark_learning/project/spark-project-sql/target/test-classes:/Users/apple/IdeaProjects/spark_learning/project/spark-project-sql/target/classes:/Users/apple/server/mavenrep/org/apache/spark/spark-graphx_2.11/2.3.3/spark-graphx_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-mllib-local_2.11/2.3.3/spark-mllib-local_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/scalanlp/breeze_2.11/0.13.2/breeze_2.11-0.13.2.jar:/Users/apple/server/mavenrep/org/scalanlp/breeze-macros_2.11/0.13.2/breeze-macros_2.11-0.13.2.jar:/Users/apple/server/mavenrep/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/Users/apple/server/mavenrep/com/github/rwl/jtransforms/2.4.0/jtransforms-2.4.0.jar:/Users/apple/server/mavenrep/org/spire-math/spire_2.11/0.13.0/spire_2.11-0.13.0.jar:/Users/apple/server/mavenrep/org/spire-math/spire-macros_2.11/0.13.0/spire-macros_2.11-0.13.0.jar:/Users/apple/server/mavenrep/org/typelevel/machinist_2.11/0.6.1/machinist_2.11-0.6.1.jar:/Users/apple/server/mavenrep/com/chuusai/shapeless_2.11/2.3.2/shapeless_2.11-2.3.2.jar:/Users/apple/server/mavenrep/org/typelevel/macro-compat_2.11/1.1.1/macro-compat_2.11-1.1.1.jar:/Users/apple/server/mavenrep/org/apache/xbean/xbean-asm5-shaded/4.4/xbean-asm5-shaded-4.4.jar:/Users/apple/server/mavenrep/com/github/fommil/netlib/core/1.1.2/core-1.1.2.jar:/Users/apple/server/mavenrep/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-tags_2.11/2.3.3/spark-tags_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/Users/apple/server/mavenrep/org/mongodb/spark/mongo-spark-connector_2.11/2.3.3/mongo-spark-connector_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar:/Users/apple/server/mavenrep/org/mongodb/mongo-java-driver/3.11.0-rc0/mongo-java-driver-3.11.0-rc0.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-core_2.11/2.3.3/spark-core_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/apache/avro/avro/1.7.7/avro-1.7.7.jar:/Users/apple/server/mavenrep/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/apple/server/mavenrep/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/apple/server/mavenrep/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/apple/server/mavenrep/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/apple/server/mavenrep/org/tukaani/xz/1.0/xz-1.0.jar:/Users/apple/server/mavenrep/org/apache/avro/avro-mapred/1.7.7/avro-mapred-1.7.7-hadoop2.jar:/Users/apple/server/mavenrep/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7.jar:/Users/apple/server/mavenrep/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7-tests.jar:/Users/apple/server/mavenrep/com/twitter/chill_2.11/0.8.4/chill_2.11-0.8.4.jar:/Users/apple/server/mavenrep/com/esotericsoftware/kryo-shaded/3.0.3/kryo-shaded-3.0.3.jar:/Users/apple/server/mavenrep/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/Users/apple/server/mavenrep/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/Users/apple/server/mavenrep/com/twitter/chill-java/0.8.4/chill-java-0.8.4.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-client/2.6.5/hadoop-client-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-common/2.6.5/hadoop-common-2.6.5.jar:/Users/apple/server/mavenrep/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/apple/server/mavenrep/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/apple/server/mavenrep/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/apple/server/mavenrep/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/apple/server/mavenrep/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/apple/server/mavenrep/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/apple/server/mavenrep/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/apple/server/mavenrep/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/apple/server/mavenrep/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/apple/server/mavenrep/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-auth/2.6.5/hadoop-auth-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/apple/server/mavenrep/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/apple/server/mavenrep/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/apple/server/mavenrep/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/apple/server/mavenrep/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar:/Users/apple/server/mavenrep/org/htrace/htrace-core/3.0.4/htrace-core-3.0.4.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-hdfs/2.6.5/hadoop-hdfs-2.6.5.jar:/Users/apple/server/mavenrep/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/apple/server/mavenrep/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/Users/apple/server/mavenrep/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-mapreduce-client-app/2.6.5/hadoop-mapreduce-client-app-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-mapreduce-client-common/2.6.5/hadoop-mapreduce-client-common-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-yarn-client/2.6.5/hadoop-yarn-client-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-yarn-server-common/2.6.5/hadoop-yarn-server-common-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.6.5/hadoop-mapreduce-client-shuffle-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-yarn-api/2.6.5/hadoop-yarn-api-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-mapreduce-client-core/2.6.5/hadoop-mapreduce-client-core-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-yarn-common/2.6.5/hadoop-yarn-common-2.6.5.jar:/Users/apple/server/mavenrep/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/apple/server/mavenrep/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/apple/server/mavenrep/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/Users/apple/server/mavenrep/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.6.5/hadoop-mapreduce-client-jobclient-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/hadoop/hadoop-annotations/2.6.5/hadoop-annotations-2.6.5.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-launcher_2.11/2.3.3/spark-launcher_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-kvstore_2.11/2.3.3/spark-kvstore_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/Users/apple/server/mavenrep/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar:/Users/apple/server/mavenrep/com/fasterxml/jackson/core/jackson-annotations/2.6.7/jackson-annotations-2.6.7.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-network-common_2.11/2.3.3/spark-network-common_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-network-shuffle_2.11/2.3.3/spark-network-shuffle_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-unsafe_2.11/2.3.3/spark-unsafe_2.11-2.3.3.jar:/Users/apple/server/mavenrep/net/java/dev/jets3t/jets3t/0.9.4/jets3t-0.9.4.jar:/Users/apple/server/mavenrep/org/apache/httpcomponents/httpcore/4.4.1/httpcore-4.4.1.jar:/Users/apple/server/mavenrep/org/apache/httpcomponents/httpclient/4.5/httpclient-4.5.jar:/Users/apple/server/mavenrep/commons-codec/commons-codec/1.13/commons-codec-1.13.jar:/Users/apple/server/mavenrep/javax/activation/activation/1.1.1/activation-1.1.1.jar:/Users/apple/server/mavenrep/org/bouncycastle/bcprov-jdk15on/1.52/bcprov-jdk15on-1.52.jar:/Users/apple/server/mavenrep/com/jamesmurty/utils/java-xmlbuilder/1.1/java-xmlbuilder-1.1.jar:/Users/apple/server/mavenrep/net/iharder/base64/2.3.8/base64-2.3.8.jar:/Users/apple/server/mavenrep/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar:/Users/apple/server/mavenrep/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar:/Users/apple/server/mavenrep/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/apple/server/mavenrep/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/Users/apple/server/mavenrep/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/Users/apple/server/mavenrep/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar:/Users/apple/server/mavenrep/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/Users/apple/server/mavenrep/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/apple/server/mavenrep/org/slf4j/slf4j-api/1.7.16/slf4j-api-1.7.16.jar:/Users/apple/server/mavenrep/org/slf4j/jul-to-slf4j/1.7.16/jul-to-slf4j-1.7.16.jar:/Users/apple/server/mavenrep/org/slf4j/jcl-over-slf4j/1.7.16/jcl-over-slf4j-1.7.16.jar:/Users/apple/server/mavenrep/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/apple/server/mavenrep/org/slf4j/slf4j-log4j12/1.7.16/slf4j-log4j12-1.7.16.jar:/Users/apple/server/mavenrep/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/Users/apple/server/mavenrep/org/xerial/snappy/snappy-java/1.1.2.6/snappy-java-1.1.2.6.jar:/Users/apple/server/mavenrep/org/lz4/lz4-java/1.4.0/lz4-java-1.4.0.jar:/Users/apple/server/mavenrep/com/github/luben/zstd-jni/1.3.2-2/zstd-jni-1.3.2-2.jar:/Users/apple/server/mavenrep/org/roaringbitmap/RoaringBitmap/0.5.11/RoaringBitmap-0.5.11.jar:/Users/apple/server/mavenrep/commons-net/commons-net/2.2/commons-net-2.2.jar:/Users/apple/server/mavenrep/org/json4s/json4s-jackson_2.11/3.2.11/json4s-jackson_2.11-3.2.11.jar:/Users/apple/server/mavenrep/org/json4s/json4s-core_2.11/3.2.11/json4s-core_2.11-3.2.11.jar:/Users/apple/server/mavenrep/org/json4s/json4s-ast_2.11/3.2.11/json4s-ast_2.11-3.2.11.jar:/Users/apple/server/mavenrep/org/scala-lang/scalap/2.11.0/scalap-2.11.0.jar:/Users/apple/server/mavenrep/org/scala-lang/scala-compiler/2.11.0/scala-compiler-2.11.0.jar:/Users/apple/server/mavenrep/org/scala-lang/modules/scala-xml_2.11/1.0.1/scala-xml_2.11-1.0.1.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/core/jersey-client/2.22.2/jersey-client-2.22.2.jar:/Users/apple/server/mavenrep/javax/ws/rs/javax.ws.rs-api/2.0.1/javax.ws.rs-api-2.0.1.jar:/Users/apple/server/mavenrep/org/glassfish/hk2/hk2-api/2.4.0-b34/hk2-api-2.4.0-b34.jar:/Users/apple/server/mavenrep/org/glassfish/hk2/hk2-utils/2.4.0-b34/hk2-utils-2.4.0-b34.jar:/Users/apple/server/mavenrep/org/glassfish/hk2/external/aopalliance-repackaged/2.4.0-b34/aopalliance-repackaged-2.4.0-b34.jar:/Users/apple/server/mavenrep/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:/Users/apple/server/mavenrep/org/glassfish/hk2/hk2-locator/2.4.0-b34/hk2-locator-2.4.0-b34.jar:/Users/apple/server/mavenrep/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/core/jersey-common/2.22.2/jersey-common-2.22.2.jar:/Users/apple/server/mavenrep/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/bundles/repackaged/jersey-guava/2.22.2/jersey-guava-2.22.2.jar:/Users/apple/server/mavenrep/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/core/jersey-server/2.22.2/jersey-server-2.22.2.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/media/jersey-media-jaxb/2.22.2/jersey-media-jaxb-2.22.2.jar:/Users/apple/server/mavenrep/javax/validation/validation-api/1.1.0.Final/validation-api-1.1.0.Final.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/containers/jersey-container-servlet/2.22.2/jersey-container-servlet-2.22.2.jar:/Users/apple/server/mavenrep/org/glassfish/jersey/containers/jersey-container-servlet-core/2.22.2/jersey-container-servlet-core-2.22.2.jar:/Users/apple/server/mavenrep/io/netty/netty-all/4.1.17.Final/netty-all-4.1.17.Final.jar:/Users/apple/server/mavenrep/io/netty/netty/3.9.9.Final/netty-3.9.9.Final.jar:/Users/apple/server/mavenrep/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/Users/apple/server/mavenrep/io/dropwizard/metrics/metrics-core/3.1.5/metrics-core-3.1.5.jar:/Users/apple/server/mavenrep/io/dropwizard/metrics/metrics-jvm/3.1.5/metrics-jvm-3.1.5.jar:/Users/apple/server/mavenrep/io/dropwizard/metrics/metrics-json/3.1.5/metrics-json-3.1.5.jar:/Users/apple/server/mavenrep/io/dropwizard/metrics/metrics-graphite/3.1.5/metrics-graphite-3.1.5.jar:/Users/apple/server/mavenrep/com/fasterxml/jackson/core/jackson-databind/2.6.7.1/jackson-databind-2.6.7.1.jar:/Users/apple/server/mavenrep/com/fasterxml/jackson/module/jackson-module-scala_2.11/2.6.7.1/jackson-module-scala_2.11-2.6.7.1.jar:/Users/apple/server/mavenrep/org/scala-lang/scala-reflect/2.11.8/scala-reflect-2.11.8.jar:/Users/apple/server/mavenrep/com/fasterxml/jackson/module/jackson-module-paranamer/2.7.9/jackson-module-paranamer-2.7.9.jar:/Users/apple/server/mavenrep/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/Users/apple/server/mavenrep/oro/oro/2.0.8/oro-2.0.8.jar:/Users/apple/server/mavenrep/net/razorvine/pyrolite/4.13/pyrolite-4.13.jar:/Users/apple/server/mavenrep/net/sf/py4j/py4j/0.10.7/py4j-0.10.7.jar:/Users/apple/server/mavenrep/org/apache/commons/commons-crypto/1.0.0/commons-crypto-1.0.0.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-sql_2.11/2.3.3/spark-sql_2.11-2.3.3.jar:/Users/apple/server/mavenrep/com/univocity/univocity-parsers/2.5.9/univocity-parsers-2.5.9.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-sketch_2.11/2.3.3/spark-sketch_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/apache/spark/spark-catalyst_2.11/2.3.3/spark-catalyst_2.11-2.3.3.jar:/Users/apple/server/mavenrep/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/Users/apple/server/mavenrep/org/codehaus/janino/janino/3.0.8/janino-3.0.8.jar:/Users/apple/server/mavenrep/org/codehaus/janino/commons-compiler/3.0.8/commons-compiler-3.0.8.jar:/Users/apple/server/mavenrep/org/antlr/antlr4-runtime/4.7/antlr4-runtime-4.7.jar:/Users/apple/server/mavenrep/org/apache/orc/orc-core/1.4.4/orc-core-1.4.4-nohive.jar:/Users/apple/server/mavenrep/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/apple/server/mavenrep/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/apple/server/mavenrep/io/airlift/aircompressor/0.8/aircompressor-0.8.jar:/Users/apple/server/mavenrep/org/apache/orc/orc-mapreduce/1.4.4/orc-mapreduce-1.4.4-nohive.jar:/Users/apple/server/mavenrep/org/apache/parquet/parquet-column/1.8.3/parquet-column-1.8.3.jar:/Users/apple/server/mavenrep/org/apache/parquet/parquet-common/1.8.3/parquet-common-1.8.3.jar:/Users/apple/server/mavenrep/org/apache/parquet/parquet-encoding/1.8.3/parquet-encoding-1.8.3.jar:/Users/apple/server/mavenrep/org/apache/parquet/parquet-hadoop/1.8.3/parquet-hadoop-1.8.3.jar:/Users/apple/server/mavenrep/org/apache/parquet/parquet-format/2.3.1/parquet-format-2.3.1.jar:/Users/apple/server/mavenrep/org/apache/parquet/parquet-jackson/1.8.3/parquet-jackson-1.8.3.jar:/Users/apple/server/mavenrep/org/apache/arrow/arrow-vector/0.8.0/arrow-vector-0.8.0.jar:/Users/apple/server/mavenrep/org/apache/arrow/arrow-format/0.8.0/arrow-format-0.8.0.jar:/Users/apple/server/mavenrep/org/apache/arrow/arrow-memory/0.8.0/arrow-memory-0.8.0.jar:/Users/apple/server/mavenrep/joda-time/joda-time/2.9.9/joda-time-2.9.9.jar:/Users/apple/server/mavenrep/com/carrotsearch/hppc/0.7.2/hppc-0.7.2.jar:/Users/apple/server/mavenrep/com/vlkan/flatbuffers/1.2.0-3f79e055/flatbuffers-1.2.0-3f79e055.jar SparkTestJoin
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
19/09/04 23:28:34 INFO SparkContext: Running Spark version 2.3.3
19/09/04 23:28:35 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
19/09/04 23:28:35 INFO SparkContext: Submitted application: SparkTestJoin
19/09/04 23:28:35 INFO SecurityManager: Changing view acls to: apple
19/09/04 23:28:35 INFO SecurityManager: Changing modify acls to: apple
19/09/04 23:28:35 INFO SecurityManager: Changing view acls groups to: 
19/09/04 23:28:35 INFO SecurityManager: Changing modify acls groups to: 
19/09/04 23:28:35 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(apple); groups with view permissions: Set(); users  with modify permissions: Set(apple); groups with modify permissions: Set()
19/09/04 23:28:36 INFO Utils: Successfully started service 'sparkDriver' on port 59923.
19/09/04 23:28:36 INFO SparkEnv: Registering MapOutputTracker
19/09/04 23:28:36 INFO SparkEnv: Registering BlockManagerMaster
19/09/04 23:28:36 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
19/09/04 23:28:36 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
19/09/04 23:28:36 INFO DiskBlockManager: Created local directory at /private/var/folders/s1/d29h6xhj3r7dnw9d5m2d626w0000gn/T/blockmgr-90bd4494-517f-455a-bba8-01688fbc77c1
19/09/04 23:28:36 INFO MemoryStore: MemoryStore started with capacity 912.3 MB
19/09/04 23:28:36 INFO SparkEnv: Registering OutputCommitCoordinator
19/09/04 23:28:36 INFO Utils: Successfully started service 'SparkUI' on port 4040.
19/09/04 23:28:36 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.1.2:4040
19/09/04 23:28:36 INFO Executor: Starting executor ID driver on host localhost
19/09/04 23:28:36 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 59924.
19/09/04 23:28:36 INFO NettyBlockTransferService: Server created on 192.168.1.2:59924
19/09/04 23:28:36 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
19/09/04 23:28:36 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.1.2, 59924, None)
19/09/04 23:28:36 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.1.2:59924 with 912.3 MB RAM, BlockManagerId(driver, 192.168.1.2, 59924, None)
19/09/04 23:28:36 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.1.2, 59924, None)
19/09/04 23:28:36 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.1.2, 59924, None)
19/09/04 23:28:37 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/Users/apple/IdeaProjects/spark_learning/spark-warehouse/').
19/09/04 23:28:37 INFO SharedState: Warehouse path is 'file:/Users/apple/IdeaProjects/spark_learning/spark-warehouse/'.
19/09/04 23:28:37 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot resolve '`bronDate`' given input columns: [];;
'Project ['bronDate]
+- LogicalRDD false

	at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42)
	at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:92)
	at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:89)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformUp$1.apply(TreeNode.scala:289)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformUp$1.apply(TreeNode.scala:289)
	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:70)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transformUp(TreeNode.scala:288)
	at org.apache.spark.sql.catalyst.plans.QueryPlan$$anonfun$transformExpressionsUp$1.apply(QueryPlan.scala:95)
	at org.apache.spark.sql.catalyst.plans.QueryPlan$$anonfun$transformExpressionsUp$1.apply(QueryPlan.scala:95)
	at org.apache.spark.sql.catalyst.plans.QueryPlan$$anonfun$1.apply(QueryPlan.scala:107)
	at org.apache.spark.sql.catalyst.plans.QueryPlan$$anonfun$1.apply(QueryPlan.scala:107)
	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:70)
	at org.apache.spark.sql.catalyst.plans.QueryPlan.transformExpression$1(QueryPlan.scala:106)
	at org.apache.spark.sql.catalyst.plans.QueryPlan.org$apache$spark$sql$catalyst$plans$QueryPlan$$recursiveTransform$1(QueryPlan.scala:118)
	at org.apache.spark.sql.catalyst.plans.QueryPlan$$anonfun$org$apache$spark$sql$catalyst$plans$QueryPlan$$recursiveTransform$1$1.apply(QueryPlan.scala:122)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
	at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
	at scala.collection.AbstractTraversable.map(Traversable.scala:104)
	at org.apache.spark.sql.catalyst.plans.QueryPlan.org$apache$spark$sql$catalyst$plans$QueryPlan$$recursiveTransform$1(QueryPlan.scala:122)
	at org.apache.spark.sql.catalyst.plans.QueryPlan$$anonfun$2.apply(QueryPlan.scala:127)
	at org.apache.spark.sql.catalyst.trees.TreeNode.mapProductIterator(TreeNode.scala:187)
	at org.apache.spark.sql.catalyst.plans.QueryPlan.mapExpressions(QueryPlan.scala:127)
	at org.apache.spark.sql.catalyst.plans.QueryPlan.transformExpressionsUp(QueryPlan.scala:95)
	at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:89)
	at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:84)
	at org.apache.spark.sql.catalyst.trees.TreeNode.foreachUp(TreeNode.scala:127)
	at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$class.checkAnalysis(CheckAnalysis.scala:84)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.checkAnalysis(Analyzer.scala:92)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:105)
	at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:57)
	at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:55)
	at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:47)
	at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:74)
	at org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$withPlan(Dataset.scala:3301)
	at org.apache.spark.sql.Dataset.select(Dataset.scala:1312)
	at org.apache.spark.sql.Dataset.select(Dataset.scala:1330)
	at org.apache.spark.sql.Dataset.select(Dataset.scala:1330)
	at SparkTestJoin.main(SparkTestJoin.java:42)
19/09/04 23:28:38 INFO SparkContext: Invoking stop() from shutdown hook
19/09/04 23:28:38 INFO SparkUI: Stopped Spark web UI at http://192.168.1.2:4040
19/09/04 23:28:38 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
19/09/04 23:28:38 INFO MemoryStore: MemoryStore cleared
19/09/04 23:28:38 INFO BlockManager: BlockManager stopped
19/09/04 23:28:38 INFO BlockManagerMaster: BlockManagerMaster stopped
19/09/04 23:28:38 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
19/09/04 23:28:38 INFO SparkContext: Successfully stopped SparkContext
19/09/04 23:28:38 INFO ShutdownHookManager: Shutdown hook called
19/09/04 23:28:38 INFO ShutdownHookManager: Deleting directory /private/var/folders/s1/d29h6xhj3r7dnw9d5m2d626w0000gn/T/spark-82b6c91d-ed14-4b65-bba2-efb4b7f2f38e

Process finished with exit code 1

 

 

處理方法 ,

添加getter  setter  方法即可 

 

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章