分佈式環境下hadoop-2.8.1,hbase-1.3.1的配置文件

分佈式環境下hadoop-2.8.1,hbase-1.3.1的配置文件

我想說的是，各種配置問題太多，一個不對就可能節點掛掉，節點不能啓動等問題，配置步驟已經寫過，現在把配置文件記錄一下，爲以後方便使用。

hadoop目錄下(h1主節點）

core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>



<configuration> 
<property>
<name>fs.defaultFS</name>
<value>hdfs://h1:9000</value>
</property>

<property>
<name>io.file.buffer.size</name>
<value>131072</value>
</property>

<property>
<name>hadoop.tmp.dir</name>
<value>/home/storm/hadoop/tmp</value>
</property>
</configuration>

hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>


<configuration>
<property>
<name>dfs.replication</name>
<value>2</value>
</property>

<property>
<name>dfs.namenode.name.dir</name>
<value>file:/home/storm/hadoop/dfs/name</value>
</property>

<property>
<name>dfs.datanode.data.dir</name>
<value>file:/home/storm/hadoop/dfs/data</value>
</property>


<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
</configuration>

slave

h2
h3

yarn-site.xml

<?xml version="1.0"?>


<configuration>
<property>
<description>The hostname of the RM.</description>
<name>yarn.resourcemanager.address</name>
<value>h1:8032</value>
</property>

<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>h1:8030</value>
</property>

<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>h1:8031</value>
</property>

<property>                 
<name>yarn.resourcemanager.admin.address</name>
<value>h1:8033</value>
</property>

<property>
<name>yarn.resourcemanager.webapp.address</name>
<value>h1:8088</value>
</property>

<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>

<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>                 
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>

hbase目錄下配置

hbase-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>


<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://h1:9000/hbase</value>
</property>

<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>

<property>
<name>hbase.zookeeper.quorum</name>
<value>h1</value>
</property>

<property>
<name>hbase.zookeeper.quorum</name>
<value>h2</value>
</property>

<property>
<name>hbase.zookeeper.quorum</name>
<value>h3</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/home/storm/hbase/zookeeper</value>
</property>

</configuration>

regionservers

h2
h3

另外需注意是否要在啓動命令.sh內部添加java路徑。