8.2GMV指標獲取的全調度流程
1)生成數據
CALL init_data(‘2019-02-12’,300,200,300,FALSE);
2)編寫Azkaban程序運行job
(1)import.job文件
type=command
do_date=${dt}
command=/home/hadoop/bin/sqoop_import.sh all {dt}
dependencies=import
command=/home/hadoop/bin/ods_db.sh {dt}
dependencies=ods
command=/home/hadoop/bin/dwd_db.sh {dt}
dependencies=dwd
command=/home/hadoop/bin/dws_db_wide.sh {dt}
dependencies=dws
command=/home/hadoop/bin/ads_db_gmv.sh ${do_date}
(6)export.job文件
type=command
dependencies=ads
command=/home/hadoop/bin/sqoop_export.sh all
(7)將以上6個文件壓縮成gmv-job.zip文件
3)創建Azkaban工程,並上傳gmv-job.zip文件。
4)等待大約20分鐘,在MySQL中查看結果
select * fromads_gmv_sum_day;