1

我是 cloudera 的新手....,我已经在使用 oozie、flume、hive 和 impala....,我有一个可以根据需要手动工作的过程。我想使用 oozie 来改进功能以优化流程。Flume,是不是因为 Flume 不需要调度,只需将 oozie 用于 hive 和 impala。当数据进入 Hive 时......,想法是将信息复制到另一个支持 parquet 格式的表并在 Impala 上读取它......我试图将信息从一个表覆盖到另一个表,手动它工作得很好,但是当我做

INSERT OVERWRITE TABLE table_impala SELECT * FROM table_hive

oozie 永远不会结束工作流程并始终保持在 50% ......我将 hive-site.xml 复制到 HDFS 路径并添加到 xml。

2017-11-24 07:05:43,184 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] Start action [0000068-171123082943192-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-11-24 07:05:43,185 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] [***0000068-171123082943192-oozie-oozi-W@:start:***]Action status=DONE
2017-11-24 07:05:43,185 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] [***0000068-171123082943192-oozie-oozi-W@:start:***]Action updated in DB!
2017-11-24 07:05:43,256 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000068-171123082943192-oozie-oozi-W@:start:
2017-11-24 07:05:43,256 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000068-171123082943192-oozie-oozi-W
2017-11-24 07:05:43,294 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] Start action [0000068-171123082943192-oozie-oozi-W@hive-8ab7] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-11-24 07:05:46,435 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] checking action, hadoop job ID [job_1511505168592_0020] status [RUNNING]
2017-11-24 07:05:46,442 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] [***0000068-171123082943192-oozie-oozi-W@hive-8ab7***]Action status=RUNNING
2017-11-24 07:05:46,443 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] [***0000068-171123082943192-oozie-oozi-W@hive-8ab7***]Action updated in DB!
2017-11-24 07:05:46,470 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] No Notification URL is defined. Therefore nothing to notify for job 0000068-171123082943192-oozie-oozi-W@hive-8ab7
4

0 回答 0