0

当我在 yarn 上使用Azkabanjobtype 执行spark任务时,Azkaban 一直无法从execution-jar我设置的路径中找到。

执行-jar hdfs:///offline/spark/jars/test.jar

Azkaban会从我的本地路径加载文件,然后报找不到文件的错误:

02-06-2021 14:22:29 CST yarn_test ERROR - java.lang.Exception: Job set up failed: execution jar is suppose to be in this folder, but the folder doesn't exist: /root/azkaban/exec/executions/13/hdfs:///offline/spark/jars/pdns cause: java.lang.Exception: Job set up failed: execution jar is suppose to be in this folder, but the folder doesn't exist: /root/azkaban/exec/executions/13/hdfs:///offline/spark/jars

[![在此处输入图像描述][1]][1] [1]:https://i.stack.imgur.com/Z7UM6.png

我该如何解决这个问题?谢谢您的帮助!

4

0 回答 0