0

我正在使用通过 Azure ACS 安装的 dcos,并通过带有默认选项的 dcos 工具安装 hdfs 和 spark。

创建 SparkStreamingContext 给出:

16/07/22 01:51:04 WARN DFSUtil: Namenode for hdfs remains unresolved for ID nn1. Check your hdfs-site.xml file to ensure namenodes are configured properly. 
16/07/22 01:51:04 WARN DFSUtil: Namenode for hdfs remains unresolved for ID nn2. Check your hdfs-site.xml file to ensure namenodes are configured properly.
Exception in thread "main" java.lang.IllegalArgumentException:
java.net.UnknownHostException: namenode1.hdfs.mesos

我希望我必须dcos package install使用 --options= 重新部署 spark 包,但无法弄清楚hdfs.config-url应该是什么。https://docs.mesosphere.com/1.7/usage/service-guides/spark/install/#hdfs文档似乎已过时。

4

1 回答 1

1

Yes, it is out of date. We'll fix that.

DC/OS HDFS now serves its config on http://hdfs.marathon.mesos:[port]/v1/connect

于 2016-08-04T18:32:08.877 回答