1

我从http://apache.techartifact.com/mirror/hadoop/common/hadoop-1.1.2/hadoop-1.1.2-bin.tar.gz下载了 Hadoop 1.1.2 。它的本机目录没有 LZO 本机库。

$查找~/softwares/hadoop-1.1.2/lib/native/

/home/deepakkv/softwares/hadoop-1.1.2/lib/native/
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.la
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.a
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so.1
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so.1.0.0

/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.la
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.a
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so.1
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so.1.0.0

$

当我在本地模式下使用 PigServer 运行 PIG 脚本时，我看到以下错误

parquet.hadoop.BadConfigurationException：找不到类 com.hadoop.compression.lzo.LzoCodec

我怎样才能得到 jar 文件和本地人？

4

1 回答 1

2

LZO 是 GPL 许可的，因此它不能与 hadoop 一起提供（与基于 BSD 的 snappy 不同），您可以从 https://github.com/toddlipcon/hadoop-lzo 构建 LZO或从https://code.google下载。 com/p/hadoop-gpl-packing/

于 2013-04-28T18:21:51.070 回答