hadoop2.2.0安裝的幾個配置文件

在自己安裝hadoop 僞分佈模式下幾個配置文件

core-siet.xml

<configuration>
<property>
    <name>fs.default.name</name>
    <value>hdfs://localhost:9000</value>
  </property>


  <property>
    <name>hadoop.tmp.dir</name>
    <value>/home/hadoop2/tmp</value>
  </property>
</configuration>

hdfs-site.xml

<configuration>
<property>
   <name>dfs.namenode.name.dir</name>
   <value>/home/hadoop2/namenode</value>
  </property>
 
  <property>
   <name>dfs.datanode.data.dir</name>
   <value>/home/hadoop2/datanode</value>
  </property>


<property>
  <name>dfs.replication</name>
  <value>1</value>
</property>
</configuration>

yarn-site.xml

<configuration>


<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>


<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>

安裝完成後啓動時碰到如下問題

localhost: Error: JAVA_HOME is not set and could not be found.

解決辦法

vim libexec/hadoop-config.sh 

export JAVA_HOME=/usr/java/jdk
# Attempt to set JAVA_HOME if it is not set
if [[ -z $JAVA_HOME ]]; then
  # On OSX use java_home (or /Library for older versions)
  if [ "Darwin" == "$(uname -s)" ]; then
    if [ -x /usr/libexec/java_home ]; then
      export JAVA_HOME=($(/usr/libexec/java_home))
    else
      export JAVA_HOME=(/Library/Java/Home)
    fi
  fi


  # Bail if we did not detect it
  if [[ -z $JAVA_HOME ]]; then
    echo "Error: JAVA_HOME is not set and could not be found." 1>&2
    exit 1
  fi
fi

使用 start-all.sh  start-yarn.sh啓動後，使用jps 有如下的些進程

14048 SecondaryNameNode
13594 NameNode
14201 ResourceManager
13794 DataNode
14416 NodeManager
14463 Jps