Sqoop-1.4.6安裝部署

部署的前提是已經存在HADOOP、HBASE、HIVE、ZOOKEEPER環境

(1)下載地址:sqoop-1.4.6

解壓到/home/sqoop/sqoop1.4

(2)、配置環境變量在:/etc/profiles 文件中添加下面內容

#sqoop 

export SQOOP_HOME=/home/sqoop/sqoop1.4

export PATH=$PATH:$SQOOP_HOME/bin

(3)、修改sqoop配置文件

複製sqoop1.4/conf/sqoop-env-template.sh爲sqoop-env.sh

命令: cp  $SQOOP_HOME/conf/sqoop-env-template.sh     $SQOOP_HOME/conf/sqoop-env.sh

添加相關的配置 (只需把sqoop-env.sh中#號去掉然後把=右邊填上對應的路徑就行了,分別是HADOOP,HBASE,HIVE,ZOOKEEPER的主目錄)

#Setpath to where bin/hadoop is available

export HADOOP_COMMON_HOME=/home/hadoop/hadoop

#Setpath to where hadoop-*-core.jar isavailable

expor tHADOOP_MAPRED_HOME=/home/hadoop/hadoop

#setthe path to where bin/hbase isavailable

export HBASE_HOME=/home/hbase/hbase 

#Setthe path to where bin/hive is available

export HIVE_HOME= /home/hive/hive

#Setthe path for where zookeper config diris

export ZOOCFGDIR= /home/zookeeper/zookeeper

(4)、測試Sqoop

發現有警告

修改$SQOOP_HOME/bin/configure-sqoop

註釋掉HCatalog,Accumulo檢查(除非你準備使用HCatalog,Accumulo等HADOOP上的組件) 

## Moved to be a runtime check in sqoop.

#if [ ! -d "${HCAT_HOME}" ]; then

# echo "Warning: $HCAT_HOME does not exist! HCatalog jobs willfail."

# echo 'Please set $HCAT_HOME to the root of your HCatalog installation.'

#fi

#if [ ! -d "${ACCUMULO_HOME}" ];then

# echo "Warning: $ACCUMULO_HOME does not exist! Accumulo imports willfail."

# echo 'Please set $ACCUMULO_HOME to the root of your Accumuloinstallation.'

#fi 

再次執行sqoop version

18/03/31 09:13:28 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.5.2

Sqoop 1.4.6-cdh5.5.2

查看某一個命令的使用說明:

$ sqoopimport --help

$ sqoophelp import

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章