hadoop - 我们如何在 Pig 的单行中组合多行

Question

我需要使用 Pig 脚本将这多个元组组合成一个元组。您能否提供一些指导方针？

dump requestFile;

电流输出

(Logging Transaction ID:21214,/var/log/tibco/,NESS-A-1-LPNameRequesttoNESS.log,tibcoTest log)

(Default Data:LP Name Request Message Executed Successfully)

(LoanPath Request ID:  88128640)

(RequestGroupID#:   )

(SplitCount#:  2 )

(SplitIndex:  1)

(Correlation ID : 88128640-1 )

期望的输出

(Logging Transaction ID:21214,/var/log/tibco/,NESS-A-1-LPNameRequesttoNESS.log,tibcoTest log,Default Data:LP Name Request Message Executed Successfully,LoanPath Request ID:  88128640,RequestGroupID#:   ,SplitCount#:  2,SplitIndex:  1)
(Correlation ID : 88128640-1 )

Answer 1

关于什么：

requestFile = foreach requestFile generate flatten(tuple);
G = GROUP requestFile ALL;
F = FOREACH G generate requestFile;