2

根据这个 JIRA ( https://issues.apache.org/jira/browse/TOREE-369),Apache Toree 支持在 YARN Cluster 模式下运行内核。但我无法运行它。下面是我正在使用的 kernel.json,

{
  "language": "scala",
  "display_name": "Remote - Scala",
  "env": {
    "__TOREE_SPARK_OPTS__": "--master yarn --deploy-mode cluster",
    "SPARK_HOME": "/usr/hdp/latest/spark",
    "__TOREE_OPTS__": "",
    "DEFAULT_INTERPRETER": "Scala",
    "PYTHON_EXEC": "python"
  },
  "argv": [
    "/usr/local/share/jupyter/kernels/apache_toree_scala/bin/run.sh",
    "--profile",
    "{connection_file}"
  ]
}

请帮忙!

4

0 回答 0