es導hive以及hive一些基本操作

hive基本操作

hive;
show databases;
use xesoa;
show tables;
show create table api_relation_student_live;
 desc api_relation_student_live;
drop table if exists api_relation_student_live;
yarn logs -applicationId application_1524544136087_10502 -appOwner hadoopuser

進入hive client前設置隊列權限
hive --hiveconf mapreduce.job.queuename=root.jiaoguan.xesoa
進入hive_client後設置隊列權限
set mapreduce.job.queuename=root.budata.ads;

自己最近用到的命令記一下：

完整複製表結構和數據。
CREATE TABLE student_bak AS SELECT * FROM student;
僅複製表結構。
CREATE TABLE student2 LIKE student;
查找一定pattern的表結構
show tables like "*finish_plan*";
查看hdfs文件的前幾行
hadoop dfs -cat hdfs://sjhlproduction/apps/hive/warehouse/dm_dp.db/dm_teach_live_stu_libarts_stat/dt=2019-05-19/fk_year=18/000444_0 |head -n 10
列出directory下的文件及文件夾
hadoop dfs -ls hdfs://sjhlproduction/apps/hive/warehouse/dm_dp.db/dm_teach_live_stu_libarts_stat/dt=2019-05-19

yarn操作
pyspark --queue budata.hadoop

yarn logs -applicationId application_1575257398773_69682 >1.log
yarn application -kill application_1575257398773_110887
yarn application help查看執行指令，比如
yarn application -list  |grep

dimdb,dm_bi,dm_dp,dm_mob,dwddb,dwsdb,ods,odsdb,