OOZIE JA017: Unknown hadoop job

OOZIE執行任務,集羣上任務已經執行完成,但是報以下錯誤導致任務fail

org.apache.oozie.action.ActionExecutorException: JA017: Unknown hadoop job [job_1457427498649_0244] associated with action [0000000-160311153311456-oozie-jd_a-W@mr-node].  Failing this action!
	at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1200)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:181)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:55)
	at org.apache.oozie.command.XCommand.call(XCommand.java:281)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

後來發現 yarn-site.xml中配置了以下配置:

<property>
    <name>yarn.log-aggregation-fs</name>
    <value>hdfs://ns5</value>
</property>
導致任務執行日誌都遷移到ns5,而我的任務跑在ns3上。把這個配置刪除,任務成功執行。


此外從其他文章中看到有可能

yarn-site.xml中
<property>
<name>mapreduce.jobhistory.intermediate-done-dir</name>
<value>/user/history/done</value>
</property>

mapred-site.xml中
<property>
<name>mapreduce.jobhistory.intermediate-done-dir</name>
<value>/user/history/done_intermediate</value>
</property>
不一致也會導致任務出現這種失敗

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章