我正在使用通过 Azure ACS 安装的 dcos,并通过带有默认选项的 dcos 工具安装 hdfs 和 spark。
创建 SparkStreamingContext 给出:
16/07/22 01:51:04 WARN DFSUtil: Namenode for hdfs remains unresolved for ID nn1. Check your hdfs-site.xml file to ensure namenodes are configured properly.
16/07/22 01:51:04 WARN DFSUtil: Namenode for hdfs remains unresolved for ID nn2. Check your hdfs-site.xml file to ensure namenodes are configured properly.
Exception in thread "main" java.lang.IllegalArgumentException:
java.net.UnknownHostException: namenode1.hdfs.mesos
我希望我必须dcos package install
使用 --options= 重新部署 spark 包,但无法弄清楚hdfs.config-url
应该是什么。https://docs.mesosphere.com/1.7/usage/service-guides/spark/install/#hdfs文档似乎已过时。