YCSB 對 hadoop2.2 與 hbase 0.96 沒有一個好的安裝教程,多多少少都會有些問題,所以寫下這篇文章,希望可以幫上正在安裝的你。
- 用 git 下載 YCSB 到本機系統,若操作系統沒有裝 git ,可直接安裝 ubuntu (sudo apt-get install git)
git clone http://github.com/brianfrankcooper/YCSB.git
- 安裝 maven,wget http://apache.fayea.com/apache-mirror/maven/maven-3/3.1.1/binaries/apache-maven-3.1.1-bin.tar.gz
1).tar -zxvf apache-maven-3.1.1-bin.tar.gz
2).tvi /etc/profile
3).export MAVEN_HOME=/home/hadoop/apache-maven-3.1.1
export PATH=$JAVA_HOME/bin:$PATH:$MAVEN_HOME/bin
4).source /etc/profile
- cd YCSB
1).vi YCSB/pom.xml
<hbase.version>your hbase version</hbase.verion>
2).註釋 <module>infinispan</module>
3).vi YCSB/hbase/pom.xml
添加
<dependency>
<groupid>org.apache.hbase</groupid>
<artifactid>hbase-client</artifactid>
<version>0.96.0-hadoop2</version>
</dependency>
<dependency>
<groupid>org.apache.hadoop</groupid>
<artifactid>hadoop-common</artifactid>
<version>2.2.0</version>
</dependency>
<!-- <dependency>
<groupid>org.apache.hbase</groupid>
<artifactid>hbase</artifactid>
<version>{hbase.version}</version>
</dependency>
<dependency>
<groupid>org.apache.hadoop</groupid>
<artifactid>hadoop-core</artifactid>
<version>1.0.0</version>
</dependency> -->
此段依賴代碼註釋掉
- 4.mvn clean package
- 5.cp distribution/target/ycsb*.gz
- 6.解壓 tar-zxvf ycsb*gz
- 7.拷貝 hadoop-auth.-2.2.0jar 至 ycsb/hbase-building/lib 中
- 8 cp $HBASE_HOME/conf/hbase.site.xml 到 ycsb/hbase-building/conf/ 中
屆時安裝完成測試
hbase(main):004:0> create "usertable","family"
0 row(s) in 0.5800 seconds
~/ycsb-0.1.4/bin/ycsb load hbase -P ~/ycsb-0.1.4/workloads/workloada -p columnfamily=family -p recordcount=10000 -p threadcount=4 -s | tee -a workloada_load.dat
hbase(main):003:0* hbase(main):001:0> count "usertable"
Current count: 2000, row: user2679876345976412335
Current count: 3000, row: user349645708467423033
Current count: 4000, row: user4305432704820238773
Current count: 5000, row: user5172413856130882967
Current count: 6000, row: user5991838079364555435
Current count: 7000, row: user6795182229709704951
Current count: 8000, row: user7643190092256492953
Current count: 9000, row: user8483598885615797937
Current count: 10000, row: user997378877721381023