我在具有 HDP 洞察力 2.4.1.1-3 的 Azure 集群上运行 druid 0.9.0。hadoop 客户端是 2.7.1。在无数次尝试解决杰克逊的问题后,特别是:
Error: class com.fasterxml.jackson.datatype.guava.deser.HostAndPortDeserializer overrides final method deserialize.
我已经尝试了此处记录的所有解决方法
https://github.com/druid-io/druid/blob/master/docs/content/operations/other-hadoop.md
无济于事。
按照另一个面临相同问题的用户的建议,在对 jackson 依赖项进行着色后,重新编译不成功。
我尝试的最后一个案例是添加
"mapreduce.job.user.classpath.first": "true"
到我的索引任务的 jobProperties 属性,结果如下:
Diagnostics: Exception from container-launch.
Container id: container_e02_1461544451524_0047_05_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
at org.apache.hadoop.util.Shell.run(Shell.java:487)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:371)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Shell output: main : command provided 1
main : run as user is nobody
main : requested yarn user is druid
我们正在尝试运行索引作业。
任何帮助将不胜感激。有没有人在相同的设置中取得任何成功?