1

我有一些如下代码。

def computeGroupByCount(Columns: List[String], DF: DataFrame): List[JsValue] = {

  val result: ListBuffer[JsValue] = new ListBuffer[JsValue]()
  val encoder: Encoder[ColumnGroupByCount] = Encoders.product[ColumnGroupByCount]

  groupByCountColumns.par.foreach(colName => {
    val groupByCount: Array[ColumnGroupByCount] = DF
      .groupBy(colName)
      .count()
      .map(x => ResponseOnGroupByCount(colName.toString, x.getString(0), x.getLong(1)))(encoder)
      .collect()
    result += Json.toJson(groupByCount)
  })
  result.toList
}

当我运行此代码时,它给出以下错误。但它在 IntelliJ 中工作

[info]   Cause: org.codehaus.janino.InternalCompilerException: Class 'org.apache.spark.sql.catalyst.expressions.codegen.GeneratedClass' was loaded through a different loader

并抛出奇怪的代码错误

请帮助我。

4

0 回答 0