0
hive> select * from twitter_data;
  1. 查询 ID = hdumer_20160523203816_0c2b2640-f711-41b9-81fd-5ee5d2af900a 总作业 = 1 正在启动作业 1 / 1 减少任务数设置为 0,因为没有减少操作员 作业在进程内运行(本地 Hadoop) 2016-05-23 20 :38:24,120 Stage-1 map = 0%, reduce = 0% 2016-05-23 20:38:30,147 Stage-1 map = 2%, reduce = 0% 2016-05-23 20:38:32,164 Stage- 1 地图 = 5%,减少 = 0% 2016-05-23 20:38:35,193 第一阶段地图 = 8%,减少 = 0% 2016-05-23 20:38:38,209 第一阶段地图 = 11%,减少 = 0% 2016-05-23 20:38:40,218 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:38:46,242 第一阶段地图 = 16%,减少 = 0% 2016- 05-23 20:38:49,253 Stage-1 map = 19%, reduce = 0% 2016-05-23 20:38:52,263 Stage-1 map = 20%, reduce = 0% 2016-05-23 20:38 :55,272 Stage-1 map = 22%, reduce = 0% 2016-05-23 20:38:58,291 第一阶段地图 = 24%,减少 = 0% 2016-05-23 20:38:59,298 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:39:05,314 第一阶段地图 = 30%,减少 = 0% 2016-05-23 20:39:07,320 第一阶段地图 = 31%,减少 = 0% 2016-05-23 20:39:29,383 第一阶段地图 = 35%,减少 = 0 % 2016-05-23 20:39:32,390 第一阶段地图 = 38%,减少 = 0% 2016-05-23 20:39:35,398 第一阶段地图 = 40%,减少 = 0% 2016-05-23 20:39:38,404 Stage-1 map = 42%, reduce = 0% 2016-05-23 20:39:39,407 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:39:45,416 Stage -1 地图 = 49%,减少 = 0% 2016-05-23 20:39:48,423 第一阶段地图 = 50%,减少 = 0% 2016-05-23 20:39:51,430 第一阶段地图 = 53% , 减少 = 0% 2016-05-23 20:39:54,437 第一阶段地图 = 55%, 减少 = 0% 2016-05-23 20:39:55,438 第一阶段地图 = 100%, 减少 = 0% 2016 -05-23 20:40:01,450 Stage-1 map = 61%, reduce = 0% 2016-05-23 20:40:04,455 Stage-1 map = 64%, reduce = 0% 2016-05-23 20:40:07,464 Stage-1 map = 66%,减少 = 0% 2016-05-23 20:40:10,472 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:40:16,482 第一阶段地图 = 75%,减少 = 0 % 2016-05-23 20:40:19,487 第一阶段地图 = 78%,减少 = 0% 2016-05-23 20:40:22,493 第一阶段地图 = 79%,减少 = 0% 2016-05-23 20:40:24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息... FAILED:执行错误,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 MapReduce 作业已启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL 总 MapReduce花费的 CPU 时间:0 毫秒减少 = 0% 2016-05-23 20:40:04,455 第一阶段地图 = 64%,减少 = 0% 2016-05-23 20:40:07,464 第一阶段地图 = 66%,减少 = 0% 2016- 05-23 20:40:10,472 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:16,482 Stage-1 map = 75%, reduce = 0% 2016-05-23 20:40 :19,487 Stage-1 map = 78%, reduce = 0% 2016-05-23 20:40:22,493 Stage-1 map = 79%, reduce = 0% 2016-05-23 20:40:24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息... FAILED: Execution Error ,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 启动 MapReduce 作业:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL MapReduce CPU 总花费时间:0 毫秒减少 = 0% 2016-05-23 20:40:04,455 第一阶段地图 = 64%,减少 = 0% 2016-05-23 20:40:07,464 第一阶段地图 = 66%,减少 = 0% 2016- 05-23 20:40:10,472 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:16,482 Stage-1 map = 75%, reduce = 0% 2016-05-23 20:40 :19,487 Stage-1 map = 78%, reduce = 0% 2016-05-23 20:40:22,493 Stage-1 map = 79%, reduce = 0% 2016-05-23 20:40:24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息... FAILED: Execution Error ,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 启动 MapReduce 作业:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL MapReduce CPU 总花费时间:0 毫秒0 毫秒0 毫秒455 Stage-1 map = 64%, reduce = 0% 2016-05-23 20:40:07,464 Stage-1 map = 66%, reduce = 0% 2016-05-23 20:40:10,472 Stage-1 map = 100%,减少 = 0% 2016-05-23 20:40:16,482 第一阶段地图 = 75%,减少 = 0% 2016-05-23 20:40:19,487 第一阶段地图 = 78%,减少 = 0 % 2016-05-23 20:40:22,493 第一阶段地图 = 79%,减少 = 0% 2016-05-23 20:40:24,498 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息...失败:执行错误,从 org.apache.hadoop.hive 返回代码 2。 ql.exec.mr.MapRedTask MapReduce 作业启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL MapReduce CPU 总时间花费:0 毫秒455 Stage-1 map = 64%, reduce = 0% 2016-05-23 20:40:07,464 Stage-1 map = 66%, reduce = 0% 2016-05-23 20:40:10,472 Stage-1 map = 100%,减少 = 0% 2016-05-23 20:40:16,482 第一阶段地图 = 75%,减少 = 0% 2016-05-23 20:40:19,487 第一阶段地图 = 78%,减少 = 0 % 2016-05-23 20:40:22,493 第一阶段地图 = 79%,减少 = 0% 2016-05-23 20:40:24,498 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息...失败:执行错误,从 org.apache.hadoop.hive 返回代码 2。 ql.exec.mr.MapRedTask MapReduce 作业启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL MapReduce CPU 总时间花费:0 毫秒减少 = 0% 2016-05-23 20:40:10,472 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:40:16,482 第一阶段地图 = 75%,减少 = 0% 2016- 05-23 20:40:19,487 Stage-1 map = 78%, reduce = 0% 2016-05-23 20:40:22,493 Stage-1 map = 79%, reduce = 0% 2016-05-23 20:40 :24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息。 .. 失败:执行错误,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 MapReduce 作业已启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL MapReduce CPU 总花费时间: 0 毫秒减少 = 0% 2016-05-23 20:40:10,472 第一阶段地图 = 100%,减少 = 0% 2016-05-23 20:40:16,482 第一阶段地图 = 75%,减少 = 0% 2016- 05-23 20:40:19,487 Stage-1 map = 78%, reduce = 0% 2016-05-23 20:40:22,493 Stage-1 map = 79%, reduce = 0% 2016-05-23 20:40 :24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,获取调试信息。 .. 失败:执行错误,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 MapReduce 作业已启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL MapReduce CPU 总花费时间: 0 毫秒减少 = 0% 2016-05-23 20:40:19,487 第一阶段地图 = 78%,减少 = 0% 2016-05-23 20:40:22,493 第一阶段地图 = 79%,减少 = 0% 2016- 05-23 20:40:24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 期间出现错误错误作业,获取调试信息...失败:执行错误,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 MapReduce 作业已启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL 总 MapReduce CPU 时间花费:0 毫秒减少 = 0% 2016-05-23 20:40:19,487 第一阶段地图 = 78%,减少 = 0% 2016-05-23 20:40:22,493 第一阶段地图 = 79%,减少 = 0% 2016- 05-23 20:40:24,498 Stage-1 map = 100%, reduce = 0% 2016-05-23 20:40:30,520 Stage-1 map = 81%, reduce = 0% Ended Job = job_local348040558_0001 期间出现错误错误作业,获取调试信息...失败:执行错误,从 org.apache.hadoop.hive.ql.exec.mr.MapRedTask 返回代码 2 MapReduce 作业已启动:Stage-Stage-1:HDFS 读取:8822964165 HDFS 写入:0 FAIL 总 MapReduce CPU 时间花费:0 毫秒reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,正在获取调试信息... FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-阶段 1:HDFS 读取:8822964165 HDFS 写入:0 FAIL 总 MapReduce CPU 花费时间:0 毫秒reduce = 0% Ended Job = job_local348040558_0001 with errors 作业期间出错,正在获取调试信息... FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-阶段 1:HDFS 读取:8822964165 HDFS 写入:0 FAIL 总 MapReduce CPU 花费时间:0 毫秒

2:Hive日志文件;

2016-05-24 22:04:07,489 错误 [main]: exec.Task (SessionState.java:printError(960)) - 结束作业 = job_local932151035_0001 错误 2016-05-24 22:04:07,507 错误 [Thread-65 ]: exec.Task (SessionState.java:printError(960)) - 作业期间出错,获取调试信息... 2016-05-24 22:04:07,507 INFO [Thread-65]: Configuration.deprecation (Configuration.java :warnOnceIfDeprecated(1173)) - mapred.job.tracker 已弃用。相反,使用 mapreduce.jobtracker.address 2016-05-24 22:04:07,752 ERROR [main]: ql.Driver (SessionState.java:printError(960)) - FAILED: Execution Error, return code 2 from org.apache。 hadoop.hive.ql.exec.mr.MapRedTask 2016-05-24 22:04:07,752 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,752 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - MapReduce 作业启动:2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - Stage-Stage-1:HDFS 读取:13499720788 HDFS 写入:0 FAIL 2016-05-24 22 :04:07,753 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger ( PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,753 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 信息[main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 753 INFO [main]:ql.Driver (SessionState.java:printInfo(951)) - Stage-Stage-1:HDFS 读取:13499720788 HDFS 写入:0 FAIL 2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator .java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 753 INFO [main]:ql.Driver (SessionState.java:printInfo(951)) - Stage-Stage-1:HDFS 读取:13499720788 HDFS 写入:0 FAIL 2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator .java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 驱动程序 (SessionState.java:printInfo(951)) - Stage-Stage-1: HDFS 读取: 13499720788 HDFS 写入: 0 FAIL 2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java: printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22: 04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 驱动程序 (SessionState.java:printInfo(951)) - Stage-Stage-1: HDFS 读取: 13499720788 HDFS 写入: 0 FAIL 2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java: printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22: 04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 13499720788 HDFS 写入:0 FAIL 2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22: 04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 信息 [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 13499720788 HDFS 写入:0 FAIL 2016-05-24 22:04:07,753 INFO [main]: ql.Driver (SessionState.java:printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22: 04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 信息 [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22: 04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - printInfo(951)) - MapReduce CPU 总时间花费:0 毫秒 2016-05-24 22:04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22: 04:07,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 完成。关闭... 2016-05-24 22:04:07,764 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 关闭完成 2016-05-24 22:04:07,765 INFO [main] : log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-24 22:04:07,765 信息 [主要]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) -

谁能帮我解决这个问题:)提前谢谢

4

0 回答 0