Hadoop操作錯誤記錄

參考錯誤列表

http://www.geedoo.info/category/hadoop%E8%BF%90%E7%BB%B4

1.在手動執行bin/hdfs secondarynamenode -checkpoint force手動執行checkpoint檢查時出現錯誤

14/12/20 15:17:43 INFO common.Storage: Cannot lock storage /usr/local/hadoop/dfs/checkpoint. The directory is already locked

14/12/20 15:17:43 FATAL namenode.SecondaryNameNode: Failed to start secondary namenode

                                  java.io.IOException: Cannot lock storage /usr/local/hadoop/dfs/checkpoint. The directory is already locked

這是因爲Secondarynamenode進程正在使用，不能在運行子進程了，需kill -9 pid，在執行

2.配置zookeeper時，

java.net.NoRouteToHostException: 沒有到主機的路由                              --不僅這個有錯誤，其他主機間的操作，都提示這個

十有八九是某臺主機的防火牆限制，最好的辦法就是關閉防火牆，實際中不能這麼直接，需添加端口信任

注意：需要在  root   用戶下檢查 防火牆狀態，我在普通用戶下檢查，什麼都沒顯示，還以爲是已經關閉了

（1） 重啓後永久性生效：

開啓：chkconfig iptables on

關閉：chkconfig iptables off

（2） 即時生效，重啓後失效：

開啓：service iptables start

關閉：service iptables stop

3.啓動HDFS時報如下錯誤

have: ssh: Could not resolve hostname have: Name or service not known
loaded: ssh: Could not resolve hostname loaded: Name or service not known
VM: ssh: Could not resolve hostname VM: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
which: ssh: Could not resolve hostname which: Name or service not known
You: ssh: Could not resolve hostname You: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
might: ssh: Could not resolve hostname might: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
guard.: ssh: Could not resolve hostname guard.: Name or service not known
Java: ssh: Could not resolve hostname Java: Name or service not known
disabled: ssh: Could not resolve hostname disabled: Name or service not known
The: ssh: Could not resolve hostname The: Name or service not known
will: ssh: Could not resolve hostname will: Name or service not known
VM: ssh: Could not resolve hostname VM: Name or service not known
try: ssh: Could not resolve hostname try: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
Server: ssh: Could not resolve hostname Server: Name or service not known
guard: ssh: Could not resolve hostname guard: Name or service not known
to: ssh: Could not resolve hostname to: Name or service not known
64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known
you: ssh: Could not resolve hostname you: Name or service not known
highly: ssh: Could not resolve hostname highly: Name or service not known



系統一直提示不能解析主機，這不扯淡嗎，這都是些什麼主機名稱，沒得辦法，問度娘最後找到這一條解決了我的問題

解決方案：
輸出native環境變量
export HADOOP_COMMON_LIB_NATIVE_DIR=/app/cloud/hadoop/hadoop-2.4.0/lib/native