根据这个 JIRA ( https://issues.apache.org/jira/browse/TOREE-369),Apache Toree 支持在 YARN Cluster 模式下运行内核。但我无法运行它。下面是我正在使用的 kernel.json,
{
"language": "scala",
"display_name": "Remote - Scala",
"env": {
"__TOREE_SPARK_OPTS__": "--master yarn --deploy-mode cluster",
"SPARK_HOME": "/usr/hdp/latest/spark",
"__TOREE_OPTS__": "",
"DEFAULT_INTERPRETER": "Scala",
"PYTHON_EXEC": "python"
},
"argv": [
"/usr/local/share/jupyter/kernels/apache_toree_scala/bin/run.sh",
"--profile",
"{connection_file}"
]
}
请帮忙!