sqoop1.4.6安裝部署

安裝部署環境

Hadoop 2.7.3

jdk1.8

mysql 5.6

sqoop-1.4.6-cdh5.7.5.tar

sqoop安裝

1.解壓 sqoop-1.4.6-cdh5.7.5.tar 至/opt/behApache/core 重命名爲sqoop

2.拷貝mysql的jdbc驅動包 mysql-connector-java-5.1.30.jar 到sqoop/lib目錄下

3.配置環境變量

export SQOOP_HOME=/opt/behApache/core/sqoop
export PATH=PATH: SQOOP_HOME/bin

4.複製sqoop/conf/sqoop-env-template.sh爲sqoop-env.sh

添加相關配置：

#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/opt/behApache/core/hadoop

#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/behApache/core/hadoop

#set the path to where bin/hbase is available
export HBASE_HOME=/opt/behApache/core/hbase

#Set the path to where bin/hive is available
export HIVE_HOME=/opt/behApache/core/hive

#Set the path for where zookeper config dir is
export ZOOCFGDIR=/opt/behApache/core/zookeeper

測試

sqoop import --connect jdbc:mysql://test104:3306/sqoop --username root --password 123456 --table test01

報錯：

Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject

解決：

下載json.jar包放到sqoop/lib下

重新執行，查看hdfs，導入成功。