将 S3 文件路径传递给 yarn.package.path 时出现以下异常。
Exception in thread "main" java.lang.NullPointerException
at org.apache.hadoop.fs.s3native.NativeS3FileSystem.getFileStatus(NativeS3FileSystem.java:433)
at org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.scala:111)
at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54)
at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:62)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37)
我能够从同一个框中卷曲 s3 文件(在导出 AWS 环境变量之后)。这是在我的作业属性文件中设置包路径的方式:
yarn.package.path=s3n://{ACCESS_KEY}:{SECRET_KEY}@bucketname/path1/path2/tar.gz