Sqoop 1.4.7安裝與配置

sqoop 安裝

1下載

下載地址：http://www.apache.org/dyn/closer.lua/sqoop/1.4.7

2.解壓

tar -xzvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /soft/

3.配置

 a)環境變量

export SQOOP_HOME=/soft/sqoop
export PATH=$PATH:$SQOOP_HOME/bin

b)sqoop-env.sh

 #[sqoop/conf/sqoop-env.sh]
export HADOOP_COMMON_HOME=/soft/hadoop/etc/hadoop
export HADOOP_MAPRED_HOME=/soft/hadoop/etc/hadoop

3.配置mysql驅動程序

cp mysql-connector-xx.jar /soft/sqoop/lib

4,驗證sqoop安裝

sqoop/bin/sqoop-version

5.查看sqoop所有幫助

sqoop help
sqoop help import

sqoop import

1.import

sqoop import --connect jdbc:mysql://192.168.174.1:3306/test \
             --driver com.mysql.jdbc.Driver \
             --username root --password root \
             --table customers \
             --target-dir /home/admin/testsqoop \
             --where "id < 1"    \
             --incremental append \
             --check-column id 

2.import-all-tables

sqoop import --connect jdbc:mysql://192.168.174.1:3306/test \
             --driver com.mysql.jdbc.Driver \
             --username root --password root \
             --table customers \
             --target-dir   #沒有該參數，默認使用表名作爲目錄

3.export

sqoop import --connect jdbc:mysql://192.168.174.1:3306/test \
             --driver com.mysql.jdbc.Driver \
             --username root --password root \
             --table customers \
             --target-dir /home/admin/customers