- 如果reduce个数过少(配置文件设置,而非自动生成),可能会出现错误:013-01-16 18:04:49,311 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.OutOfMemoryError: allocLargeObjectOrArray
- hive能自动识别join是否可以转化位mapjion。如果非要手工指定的话,可能会出现错误:
2013-01-16 03:38:48 Starting to launch local task to process map join; maximum memory = 1048576000
2013-01-16 03:38:51 Processing rows: 200000 Hashtable size: 199999 Memory usage: 90039472 rate: 0.086
...............................
2013-01-16 03:39:07 Processing rows: 2300000 Hashtable size: 2299999 Memory usage: 961646184 rate: 0.917
- 如果设置hive空值默认为'-1',那么在select one 时选出的会将'-1'显示为null。select * 会显示‘-1’
-
空值显示为NULL,而非'NULL'
CASE sms_send_count WHEN NULL THEN -1 ELSE 0 END,CASE sms_bill_count WHEN NULL THEN -1 ELSE 0 END,CASE sms_people_count WHEN NULL THEN -1 ELSE 0 END,
FAILED: Error in semantic analysis: Line 4:25 Argument type mismatch ''NULL'': The expressions after WHEN should have the same type with that after CASE: "bigint" is expected but "string" is found