hbase1.2.0-cdh5.11.2升級到hbase2.1.0-cdh6.3.0遇到的問題之hbase通過MapReduce查看錶行數

求解???
環境描述:五臺測試機器,該臺機器並非重裝linux系統,而是刪除原5.11.2集羣上的已知目錄,然後通過其他四臺機器上cdh6.3.0添加新主機。由於只有此臺機器配置高,故此臺機器上有各種自我安裝的軟件:phoenix5.0(官網最高只支持hbase2.0)。
問題描述:執行以下命令報錯

[root@worker ~]# hbase org.apache.hadoop.hbase.mapreduce.RowCounter 'TESTSALT'
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hbase/lib/phoenix-5.0.0-HBase-2.0-pig.jar!/org/slf4j  /impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hbase/lib/phoenix-5.0.0-HBase-2.0-thin-client.jar!/o  rg/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLogg  erBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the   correspond server addresses.
        at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:116)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:109)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:102)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1540)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1536)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
        at org.apache.hadoop.mapreduce.Job.connect(Job.java:1536)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1564)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1588)
        at org.apache.hadoop.hbase.mapreduce.RowCounter.run(RowCounter.java:242)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:261)

經查網友普遍認爲是jar包問題:https://stackoverflow.com/questions/33011134/cannot-initialize-cluster-please-check-your-configuration-for-mapreduce-framewo
https://www.cppentry.com/bencandy.php?fid=114&id=185228

https://blog.51cto.com/zcnick/1415560
可是我查看了其他四臺正常(文首的查看hbase錶行數)機器(重裝linux後才安裝cdh6.3.0)上

find / -name hadoop-mapreduce-client-jobclient-*.jar
find / -name hadoop-mapreduce-client-common-*.jar

僅能發現此臺異常機器僅僅多出了phoenix5的如下包:

/root/my/phoenix/phoenix-hive/target/dependency/hadoop-mapreduce-client-jobclient-3.0.0.jar
/root/my/phoenix/phoenix-hive/target/dependency/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar
/root/maven_repo/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.0.0/hadoop-mapreduce-client-jobclient-3.0.0.jar
/root/maven_repo/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.0.0/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar
/opt/cloudera/phoenix-5.0.0-HBase-2.0/lib/hadoop-mapreduce-client-jobclient-3.0.0.jar
和
/root/my/phoenix/phoenix-hive/target/dependency/hadoop-mapreduce-client-common-3.0.0.jar
/root/maven_repo/org/apache/hadoop/hadoop-mapreduce-client-common/3.0.0/hadoop-mapreduce-client-common-3.0.0.jar
/opt/cloudera/phoenix-5.0.0-HBase-2.0/lib/hadoop-mapreduce-client-common-3.0.0.jar

有點“丈二的和尚摸不着頭腦”的感覺

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章