hadoop hdfs put上傳大量文件時出現錯誤
執行命令:
bin/hdfs dfs -put -d etc/hadoop/tmpInputFile/BayesFiles/trainClassFiles /user/input_1
錯誤日誌
2019-11-10 17:03:31,380 WARN hdfs.DataStreamer: Caught exception
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1252)
at java.lang.Thread.join(Thread.java:1326)
at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:986)
at org.apache.hadoop.hdfs.DataStreamer.closeInternal(DataStreamer.java:847)
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:843)
解決方法:
在hadoop-env.sh中添加
export HADOOP_ROOT_LOGGER=DEBUG