当我在 yarn 上使用Azkaban
jobtype 执行spark
任务时,Azkaban 一直无法从execution-jar
我设置的路径中找到。
执行-jar hdfs:///offline/spark/jars/test.jar
Azkaban
会从我的本地路径加载文件,然后报找不到文件的错误:
02-06-2021 14:22:29 CST yarn_test ERROR - java.lang.Exception: Job set up failed: execution jar is suppose to be in this folder, but the folder doesn't exist: /root/azkaban/exec/executions/13/hdfs:///offline/spark/jars/pdns cause: java.lang.Exception: Job set up failed: execution jar is suppose to be in this folder, but the folder doesn't exist: /root/azkaban/exec/executions/13/hdfs:///offline/spark/jars
[![在此处输入图像描述][1]][1] [1]:https://i.stack.imgur.com/Z7UM6.png
我该如何解决这个问题?谢谢您的帮助!