集羣環境下配置hadoop1.0,zookeeper,hbase

1.本環境採用兩臺linux環境,ip分別爲: 
192.168.56.101 
192.168.56.102 
分別修改兩臺機器的/etc/hosts文件,增加如下內容: 
192.168.56.101 master 
192.168.56.102 slave 
我們以master作爲namenode服務器,slave爲datenode服務器,首先安裝jdk並配置環境變量和ssh(安裝過程省略,請參考 

網上資料) 
2.安裝hadoop,修改如下配置文件: 
兩臺機器的hadoop安裝路徑要相同,切記,切忌!!! 
1)修改core-site.xml爲: 
<?xml version="1.0"?> 
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> 

<!-- Put site-specific property overrides in this file. --> 

<configuration> 
    <property> 
        <name>fs.default.name</name> 
        <value>hdfs://master:9000</value> 
    </property> 
</configuration> 
2)修改hdfs-site.xml爲: 
<?xml version="1.0"?> 
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> 

<!-- Put site-specific property overrides in this file. --> 

<configuration> 
    <property> 
        <name>dfs.replication</name> 
        <value>1</value> 
    </property> 
    <property> 
        <name>dfs.support.append</name> 
        <value>true</value> 
    </property> 
    <property> 
        <name>dfs.datanode.max.xcievers</name> 
        <value>4096</value> 
    </property> 
</configuration> 
3)修改mapred-site.xml爲: 
<?xml version="1.0"?> 
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> 

<!-- Put site-specific property overrides in this file. --> 

<configuration> 
    <property> 
        <name>mapred.job.tracker</name> 
        <value>master:9001</value> 
    </property> 
</configuration> 
4)修改masters爲: 
master 
5)修改slaves爲: 
slave 
6)格式化hadoop文件系統: 
hadoop namenode -format 
7)啓動hadoop: 

start-all.sh

3.安裝zookeeper,修改配置文件: 
兩臺機器的zookeeper安裝路徑要相同,切記,切忌!!! 
1)cp zoo_sample.cfg zoo.cfg 
2)修改zoo.cfg爲: 
# The number of milliseconds of each tick 
tickTime=2000 
# The number of ticks that the initial 
# synchronization phase can take 
initLimit=10 
# The number of ticks that can pass between 
# sending a request and getting an acknowledgement 
syncLimit=5 
# the directory where the snapshot is stored. 
# do not use /tmp for storage, /tmp here is just 
# example sakes. 
dataDir=/tmp/zookeeper 
# the port at which the clients will connect 
clientPort=2181 
#... 
#... 
#... 
server.1=master:2888:3888 
server.2=slave:2888:3888 
3)在master的/tmp/zookeeper路徑下增加myid文件,內容爲:1 
4)在master的/tmp/zookeeper路徑下增加myid文件,內容爲:2 
補充說明:如果要單獨使用zookeeper集羣服務器,則使用zkServer.sh start命令分別啓動每個zookeeper節點 

4.安裝hbase,修改配置文件 
1)修改:hbase_env.sh的兩個屬性: 
# The java implementation to use.  Java 1.6 required. 
export JAVA_HOME=/opt/java 
# Tell HBase whether it should manage it's own instance of Zookeeper or not. 
export HBASE_MANAGES_ZK=true 
2)在兩臺機器上的hadoop文件系統中創建hbase目錄: 
hadoop fs -mkdir /hbase 
3)修改master上的hbase-site.xml文件: 
<configuration> 
    <property> 
        <name>dfs.support.append</name> 
        <value>true</value> 
    </property> 
    <property> 
    <name>hbase.rootdir</name> 
    <value>hdfs://master:9000/hbase</value> 
    <description>The directory shared by RegionServers. 
    </description> 
  </property> 
  <property> 
    <name>dfs.replication</name> 
    <value>1</value> 
    <description>The replication count for HLog and HFile storage. Should not be greater than HDFS datanode count. 
    </description> 
  </property> 
  <property>  
      <name>hbase.cluster.distributed</name> 
      <value>true</value>  
   </property>  
   <property>  
           <name>hbase.master.port</name>  
           <value>60000</value>  
   </property>  
   <property>  
           <name>hbase.zookeeper.quorum</name>  
           <value>master,slave</value>  
   </property> 
</configuration> 
4)修改slave上的hbase-site.xml文件: 
<configuration> 
    <property> 
        <name>dfs.support.append</name> 
        <value>true</value> 
    </property> 
    <property> 
    <name>hbase.rootdir</name> 
    <value>hdfs://master:9000/hbase</value> 
    <description>The directory shared by RegionServers. 
    </description> 
  </property> 
  <property> 
    <name>dfs.replication</name> 
    <value>1</value> 
    <description>The replication count for HLog and HFile storage. Should not be greater than HDFS datanode count. 
    </description> 
  </property> 
  <property>  
      <name>hbase.cluster.distributed</name> 
      <value>true</value>  
   </property>  
   <property>  
           <name>hbase.master.port</name>  
           <value>60000</value>  
   </property>  
   <property>  
           <name>hbase.zookeeper.quorum</name>  
           <value>master,slave</value>  
   </property>  
</configuration> 
5)修改regionservers文件爲: 
master 
slave 
6)啓動hbase並測試: 
start-hbase.sh 
hbase shell 
list 
哈哈,完畢! 

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章