0

我们在第一步构建流式立方体失败：从kafka保存数据，这是输出日志：

Counters: 12 
        Job Counters 
                Failed map tasks=4 
                Launched map tasks=4 
                Other local map tasks=3 
                Rack-local map tasks=1 
                Total time spent by all maps in occupied slots (ms)=10836 
                Total time spent by all reduces in occupied slots (ms)=0 
                Total time spent by all map tasks (ms)=10836 
                Total vcore-seconds taken by all map tasks=10836 
                Total megabyte-seconds taken by all map tasks=11096064 
        Map-Reduce Framework 
                CPU time spent (ms)=0 
                Physical memory (bytes) snapshot=0 
                Virtual memory (bytes) snapshot=0

谁能告诉我如何解决？

4

1 回答 1

0

当我运行 kylin 流式立方体构建时，我遇到了同样的问题。当我打开纱线日志时，我看到了

错误：java.lang.ClassNotFoundException: org.apache.kafka.clients.consumer.Consumer 在 java.lang.ClassLoader.loadClass(ClassLoader.java:424) 在 java.net.URLClassLoader.findClass(URLClassLoader.java:381) 在sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.kylin.source.kafka.hadoop.KafkaInputFormat.createRecordReader(KafkaInputFormat. java:107) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.(MapTask.java:515) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:758) at org.apache.hadoop。 mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth .Subject.doAs(Subject.java:422) 在 org.apache.hadoop.security。UserGroupInformation.doAs(UserGroupInformation.java:1758) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)`

按照这里的说明，我设置KAFKA_HOME然后重新启动kylin。没有这样的日志。

于 2018-06-29T06:08:38.807 回答