大数据常见错误（持续更新中）

1、Exception in thread "main" org.apache.spark.SparkException: Only one SparkContext may be running in this JVM (see SPARK-2243). To ignore this error, set spark.driver.allowMultipleContexts = true. The currently running SparkContext was created at:org.apache.spark.SparkContext.

解决方法：我这边是因为自己的原因创建了多个sparkContext，我将创建sparkContext的代码修改为只创建一次，程序就可以执行了。

2、Exception in thread "main" java.io.IOException: No FileSystem for scheme: hdfs

解决方法：在jar包的core-default.xml中添加如下

<property>
        <name>fs.hdfs.impl</name>
        <value>org.apache.hadoop.hdfs.DistributedFileSystem</value>
        <description>The FileSystem for hdfs: uris.</description>
</property>
<property>
        <name>fs.file.impl</name>
        <value>org.apache.hadoop.fs.LocalFileSystem</value>
        <description>The FileSystem for hdfs: uris.</description>
</property>