安装部署环境
Hadoop 2.7.3
jdk1.8
mysql 5.6
sqoop-1.4.6-cdh5.7.5.tar
sqoop安装
1.解压 sqoop-1.4.6-cdh5.7.5.tar 至/opt/behApache/core 重命名为sqoop
2.拷贝mysql的jdbc驱动包 mysql-connector-java-5.1.30.jar 到sqoop/lib目录下
3.配置环境变量
export SQOOP_HOME=/opt/behApache/core/sqoop
export PATH=
4.复制sqoop/conf/sqoop-env-template.sh为sqoop-env.sh
添加相关配置:
#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/opt/behApache/core/hadoop
#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/behApache/core/hadoop
#set the path to where bin/hbase is available
export HBASE_HOME=/opt/behApache/core/hbase
#Set the path to where bin/hive is available
export HIVE_HOME=/opt/behApache/core/hive
#Set the path for where zookeper config dir is
export ZOOCFGDIR=/opt/behApache/core/zookeeper
测试
sqoop import --connect jdbc:mysql://test104:3306/sqoop --username root --password 123456 --table test01
报错:
Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject
解决:
下载json.jar包放到sqoop/lib下
重新执行,查看hdfs,导入成功。