java - 在hadoop map reduce中读取矩阵

Question

嗨，我有一个矩阵，想将它传递给hadoop 多节点集群设置中的映射器类，但矩阵不在文件中。有什么方法可以传递矩阵而不将其写入文件？

Answer 1

In JobConf, you specify the input using the method setInputFormat. InputFormat has many classes implementing its interface.

Apart from FileInputFormat and its subclasses, you have other classes which implement InputFormat like DBInputFormat, Parser.Node and more.. See if you can use any those.

If none suits your needs, try to build your own custom InputFormat class to achieve the same.