We have hadoop implemented on linux flatform. We use scala spark to develop models using spark machine learning libraries. I just use notepad++ and create *.scala file and execute them on data nodes. I want to know can I use eclipce or Intellij IDE from my local machine (windows machine) and connect to spark to test scala spark scripts.
问问题
105 次
1 回答
0
您可以使用基于浏览器的笔记本，例如 ipython 或特别是 jupyter（因为它支持 Scala）来测试您的脚本。但是，您需要按照以下说明将其连接到 Hadoop Spark：http: //blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/
于 2017-04-20T12:56:08.353 回答