在Windows下使用Hadoop 分佈式緩存時遇到的bug

錯誤提示:

WARN [main] fs.FileUtil (FileUtil.java:symLink(824)) - Fail to create symbolic links on Windows. The default security settings in Windows disallow non-elevated administrators and all non-administrators from creating symbolic links. This behavior can be changed in the Local Security Policy management console

WARN [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(209)) - Failed to create symlink: \tmp\hadoop-root\mapred\local\1456973611218\part-r-00003 <- F:\JavaWork2014\mapreduce/part-r-00003

WARN [Thread-12] mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1862629830_0001

java.lang.Exception: java.io.FileNotFoundException: part-r-00003 (系統找不到指定的文件。)

java.lang.Exception: java.io.FileNotFoundException: file:\tmp\hadoop-root\mapred\local\1456979002661\tb_dim_city.dat (文件名、目錄名或卷標語法不正確。)
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)

Caused by: java.io.FileNotFoundException: file:\tmp\hadoop-root\mapred\local\1456979002661\tb_dim_city.dat (文件名、目錄名或卷標語法不正確。)

代碼:

public int run() throws IOException, ClassNotFoundException, InterruptedException, URISyntaxException 

{

       job.addCacheArchive(new URI(CACHE + "#length0ids"));

}


 protected void setup(Context context)

{

        FileReader fr = new FileReader("length0ids");

BufferedReader br = new BufferedReader(fr);
String line = null;
}


網上找了很多方法都沒有用,這時不妨看看項目文件夾下是否有名爲緩存文件名的類似快捷方式的文件,刪除之,bug解決。



發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章