1

在实际运行我的 BSP 作业之前，我的 hama 在输入数据分区阶段引发了以下异常。我能知道这个异常的可能根本原因是什么吗？任何有关如何找出根本原因的建议表示赞赏。谢谢！

13/11/06 03:50:50 WARN snappy.LoadSnappy: Snappy native library not loaded
13/11/06 03:50:50 INFO sync.ZKSyncClient: Initializing ZK Sync Client
13/11/06 03:50:50 INFO sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At masked-addr:33960
13/11/06 03:50:52 ERROR bsp.BSPTask: Error running bsp setup and bsp function.
java.lang.NullPointerException
    at java.lang.Class.isAssignableFrom(Native Method)
    at org.apache.hadoop.io.serializer.WritableSerialization.accept(WritableSerialization.java:100)
    at org.apache.hadoop.io.serializer.SerializationFactory.getSerialization(SerializationFactory.java:83)
    at org.apache.hadoop.io.serializer.SerializationFactory.getSerializer(SerializationFactory.java:73)
    at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:963)
    at org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:896)
    at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:393)
    at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:284)
    at org.apache.hama.bsp.PartitioningRunner.bsp(PartitioningRunner.java:217)
    at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
    at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
    at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
13/11/06 03:50:52 INFO ipc.Server: Stopping server on 33960
13/11/06 03:50:52 INFO ipc.Server: IPC Server handler 0 on 33960: exiting
13/11/06 03:50:52 INFO ipc.Server: Stopping IPC Server listener on 33960
4

1 回答 1

1

找到了根本原因。当输入路径中指定的至少一个输入文件的大小为 0 时，会发生此异常。

于 2013-11-06T10:42:43.370 回答