0

Has anyone tried using Azure data bricks as the spark cluster for CDAP job processing. CDAP documentation details how to add it to Azure HDInsight, but just wondering is there a way to configure CDAP to point to data bricks spark cluster, is it even possible? OR this kind of integration needs a specific data bricks client connector jar? If anyone has any insights that would be helpful.

4

1 回答 1

0

Azure 上的 Databricks spark 没有开箱即用的支持。但是,也就是说,您可以开发一个新的Cloud Runtime,它能够将作业提交到 Databricks spark 集群。下面是如何为Cloud DataprocEMR编写运行时扩展的示例。

于 2019-02-03T16:47:36.073 回答