How-to: deploy hadoop client with some special user based on acl enbaled cluster

This is to deploy a hadoop client with some user besides hadoop admin user to connect an acl(configure user access permission ) enabled hadoop.


At client node:

  1. Useradd client user. Here client user will be "chenfangfang". Hadoop cluster admin user is "hadoop".
  2. Edit client node /etc/hosts, to make sure this client could access existing hadoop cluster.
  3. Copy hadoop package to client node as user "chenfangfang".
  4. Configure environment variables:
    HADOOP_COMMON_HOME="/home/chenfangfang/hadoop"
    HADOOP_CONF_DIR="/home/chenfangfang/hadoop/etc/hadoop"
    HADOOP_HDFS_HOME="/home/chenfangfang/hadoop"
    HADOOP_HOME="/home/chenfangfang/hadoop"
    HADOOP_MAPRED_HOME="/home/chenfangfang/hadoop"


At hadoop cluster node:

  1. Create user directory and grant:
    hdfs mkdir /user/chenfangfang
    hdfs dfs -setfacl -m user:chenfangfang:rwx /user/chenfangfang
    hdfs dfs -setfacl -m group:chenfangfang:rwx /user/chenfangfang  
    hdfs dfs -getfacl /user/chenfangfang
  2. Grant log dir to users, this is to make sure client could launch jobs
    hdfs dfs -setfacl -m group:chenfangfang:rwx /tmp
    hdfs dfs -setfacl -m user:chenfangfang:rwx /tmp
    hdfs dfs -setfacl -m group:chenfangfang:rwx /tmp/hadoop-yarn
    hdfs dfs -setfacl -m user:chenfangfang:rwx /tmp/hadoop-yarn
    hdfs dfs -setfacl -m group:chenfangfang:rwx /tmp/hadoop-yarn/staging
    hdfs dfs -setfacl -m user:chenfangfang:rwx /tmp/hadoop-yarn/staging

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章