(4)3.3.9ODS層數據導入腳本4

3.3.9ODS層數據導入腳本

1)在/home/atguigu/bin目錄下創建腳本ods_db.sh
[atguigu@hadoop102 bin]$ vim ods_db.sh
在腳本中填寫如下內容
#!/bin/bash

APP=gmall
hive=/opt/module/hive/bin/hive

如果是輸入的日期按照取輸入日期;如果沒輸入日期取當前時間的前一天

if [ -n “$1” ] ;then
do_date=$1
else
do_date=date -d "-1 day" +%F
fi

sql="
load data inpath ‘/origin_data/APP/db/orderinfo/APP/db/order_info/do_date’OVERWRITE into table "APP".odsorderinfopartition(dt=APP".ods_order_info partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/orderdetail/APP/db/order_detail/do_date’OVERWRITE into table "APP".odsorderdetailpartition(dt=APP".ods_order_detail partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/skuinfo/APP/db/sku_info/do_date’OVERWRITE into table "APP".odsskuinfopartition(dt=APP".ods_sku_info partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/userinfo/APP/db/user_info/do_date’ OVERWRITE into table "APP".odsuserinfopartition(dt=APP".ods_user_info partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/paymentinfo/APP/db/payment_info/do_date’ OVERWRITE into table "APP".odspaymentinfopartition(dt=APP".ods_payment_info partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/basecategory1/APP/db/base_category1/do_date’ OVERWRITE into table "APP".odsbasecategory1partition(dt=APP".ods_base_category1 partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/basecategory2/APP/db/base_category2/do_date’ OVERWRITE into table "APP".odsbasecategory2partition(dt=APP".ods_base_category2 partition(dt='do_date’);

load data inpath ‘/origin_data/APP/db/basecategory3/APP/db/base_category3/do_date’ OVERWRITE into table “APP".odsbasecategory3partition(dt=APP".ods_base_category3 partition(dt='do_date’);
"
hivee"hive -e "sql”
2)增加腳本執行權限
[atguigu@hadoop102 bin]$ chmod 777 ods_db.sh
3)執行腳本導入數據
[atguigu@hadoop102 bin]$ ods_db.sh 2019-02-10
[atguigu@hadoop102 bin]$ ods_db.sh 2019-02-11
4)查詢導入數據
hive (gmall)>
select * from ods_order_info where dt='2019-02-10’limit 1;
select * from ods_order_info where dt=‘2019-02-11’ limit 1;

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章