MetaException(message:file:/user/hive/warehouse/xxxx is not a directory or unable to create one)

一 前言

在eclipse中編譯調試hive 時出現以下問題

啓動clidriver程序在 console執行命令如下

hive> create table xxxx(id int);
create table xxxx(id int);
FAILED: Error in metadata: MetaException(message:file:/user/hive/warehouse/xxxx is not a directory or unable to create one)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask

日誌內容如下

2013-05-14 19:44:12,440 ERROR exec.Task (SessionState.java:printError(401)) - FAILED: Error in metadata: MetaException(message:file:/user/hive/warehouse/xxxx is not a directory or unable to create one)
org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:file:/user/hive/warehouse/xxxx is not a directory or unable to create one)
	at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:603)
	at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3775)
	at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:256)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:144)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1349)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1135)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
Caused by: MetaException(message:file:/user/hive/warehouse/xxxx is not a directory or unable to create one)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1056)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:102)
	at $Proxy9.create_table_with_environment_context(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:466)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:455)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:74)
	at $Proxy10.createTable(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:597)
	... 12 more

但是奇怪的是用命令終端運行該命令是正常的

[niy@niy-computer hcatalog]$ hive -e "create table tst1(ll string)"

Logging initialized using configuration in jar:file:/home/niy/workspace1/hive/trunk/lib/hive-common-0.12.0-SNAPSHOT.jar!/hive-log4j.properties
Hive history file=/tmp/niy/hive_job_log_niy_201305141915_62984336.txt
OK
Time taken: 8.554 seconds

二 解決辦法

分析 ：跟蹤源碼發現filesystem fs = GetFs(conf); fs 總是LocalFileSystem。實際應該是DistributedFileSystem。

解決辦法 是在程序classpath中添加$HADOOP_HOME/conf文件路徑 。

參見http://blog.csdn.net/duguduchong/article/details/8991654