0

我正在尝试将 Scala 用于 UDF,但 Pig 作业因错误“java.lang.NoClassDefFoundError: scala/ScalaObject”而失败。我究竟做错了什么?

$ cat NonEmpty.scala

package nonempty

import org.apache.pig.FilterFunc
import org.apache.pig.data._

class NonEmpty extends FilterFunc {
  def exec(input: Tuple) = {
    val s = input.get(0)
    s match {
    case a: String => !a.isEmpty 
    case _ => false
   }
  }
}

$ 猫 ex3.pig

register ./nonempty.jar 
register ./scala-library.jar;

define NonEmpty nonempty.NonEmpty();

raw = load 'excite-small.log' using PigStorage('\t') as (user: chararray, time:chararray, query: chararray);

locations = filter raw by NonEmpty(query);

建造:

scalac -cp ~/pig-0.9.2/pig-0.9.2.jar NonEmpty.scala
jar -cf nonempty.jar nonempty

猪堆栈跟踪:

2 ---------------
3 ERROR 2998: Unhandled internal error. scala/ScalaObject
4 
5 java.lang.NoClassDefFoundError: scala/ScalaObject
(...)
4

1 回答 1

5

ScalaObject位于scala-library.jar需要包含在运行时类路径中的 。因此,添加scala-library.jar到运行程序的命令的运行时类路径中。

于 2013-01-02T17:42:40.340 回答