下面是我的 Spark 1.6 代码。我正在尝试将其转换为 Spark 2.3,但使用拆分时出现错误。
火花1.6代码:
val file = spark.textFile(args(0))
val mapping = file.map(_.split('/t')).map(a => a(1))
mapping.saveAsTextFile(args(1))
火花2.3代码:
val file = spark.read.text(args(0))
val mapping = file.map(_.split('/t')).map(a => a(1)) //Getting Error Here
mapping.write.text(args(1))
错误信息:
value split is not a member of org.apache.spark.sql.Row