8.2GMV指标获取的全调度流程
1)生成数据
CALL init_data(‘2019-02-12’,300,200,300,FALSE);
2)编写Azkaban程序运行job
(1)import.job文件
type=command
do_date=${dt}
command=/home/hadoop/bin/sqoop_import.sh all {dt}
dependencies=import
command=/home/hadoop/bin/ods_db.sh {dt}
dependencies=ods
command=/home/hadoop/bin/dwd_db.sh {dt}
dependencies=dwd
command=/home/hadoop/bin/dws_db_wide.sh {dt}
dependencies=dws
command=/home/hadoop/bin/ads_db_gmv.sh ${do_date}
(6)export.job文件
type=command
dependencies=ads
command=/home/hadoop/bin/sqoop_export.sh all
(7)将以上6个文件压缩成gmv-job.zip文件
3)创建Azkaban工程,并上传gmv-job.zip文件。
4)等待大约20分钟,在MySQL中查看结果
select * fromads_gmv_sum_day;