Hive建表(外部表external table):
CREATE EXTERNAL TABLE `table_name`(
`column1` string,
`column2` string,
`column3` string)
PARTITIONED BY (
`proc_date` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat'
LOCATION
'hdfs://ns-hf/...'
TBLPROPERTIES ()TBLPROPERTIES (
'transient_lastDdlTime'='')
添加分區並加載分區數據:
alter table table_name add partition (proc_date='${hivevar:pdate}') location '...'(不改變源數據存儲位置)
load data inpath '...' into table table_name partition(proc_date='${hivevar:pdate}');(會將源數據切到hive表指定的路徑下)