我正在开发一个使用 CDH 嵌入式 postGreSQL 的项目。几天前,我们开始确定两件事。Sqoop 创建的表(hive 表)失败了,从 hive 创建动态分区表也失败了。
错误如下
第一天:
Loading data to table raw_store.user_pdp_visits partition (view_date=null)
Failed with exception MetaException(message:javax.jdo.JDODataStoreException: Insert of object "org.apache.hadoop.hive.metastore.model.MPartition@67d2b6c" using statemen
t "INSERT INTO "PARTITIONS" ("PART_ID","PART_NAME","TBL_ID","LAST_ACCESS_TIME","CREATE_TIME","SD_ID") VALUES (?,?,?,?,?,?)" failed : ERROR: duplicate key value violates
unique constraint "PARTITIONS_pkey"
Detail: Key ("PART_ID")=(481) already exists.
NestedThrowables:
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "PARTITIONS_pkey"
Detail: Key ("PART_ID")=(481) already exists.)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
椽子:
Moving data to: hdfs://hadoop01.snapdeal.com:8020/tmp/hive-hdfs/hive_2014-05-27_09-00-19_755_4383214683545337621-1/-ext-10000/view_date=2014-05-26
Loading data to table raw_store.user_pdp_visits partition (view_date=null)
Failed with exception MetaException(message:java.lang.RuntimeException: commitTransaction was called but openTransactionCalls = 0. This probably indicates that there ar
e unbalanced calls to openTransaction/commitTransaction)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
如果有人可以为此提供一些解决方案,那将是非常棒的。