CDH 安裝 大數據組件 報錯

使用CDH來安裝大數據組件的時候，當安裝到YARN、Hbase、Spark的時候報錯，主要原因是YARN、Hbase、Spark在HDFS裏面沒有權限去創建文件

Spark

SecurityManager: authentication disabled; ui acls disabled; users
with view permissions : Set(spark); groups with view permissions:
Set(); users with modify permissions: Set(spark) ;group with 
modify permissions: Set()

運行下面的命令：

$ sudo -u hdfs hadoop fs -mkdir /user/spark
$ sudo -u hdfs hadoop fs -mkdir /user/spark/applicationHistory
$ sudo -u hdfs hadoop fs -chown -R spark:spark /user/spark
$ sudo -u hdfs hadoop fs -chmod 1777 /user/spark/applicationHistory

參考文檔

Yarn

Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=WRITE, inode="/user":hdfs:supergroup:drwxrwxr-x

運行下面的命令：

sudo -u hdfs hdfs dfs -chmod 775 /

sudo -u hdfs hdfs dfs -mkdir /user
sudo -u hdfs hdfs dfs -chown mapred:mapred /user
sudo -u hdfs hdfs dfs -mkdir /tmp
sudo -u hdfs hdfs dfs -chown mapred:mapred /tmp

參考文檔

Hbase

Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hbase, access=WRITE, inode="/user":hdfs:supergroup:drwxrwxr-x

運行下面的命令：

sudo -u hdfs hdfs dfs -mkdir /hbase
sudo -u hdfs hdfs dfs -chown hbase:hbase /hbase

仿照YARN的處理方案，嘗試一下。