google-cloud-dataflow - How would you retrieve message and optional attributes from PubSubIO?

Question

I have a topic on PubSub, and I want to create a pipeline on dataflow that reads from the topic classifies them according to message data and further read the attribute key value pairs. Is there a way to differentiate between the message and attributes after they have transformed to PCollection using the PubSubIO's read transform?

Answer 1

不幸的是，Dataflow 的 PubsubIO API 目前不处理 Pubsub 消息的元数据和属性。我想不出一个简单的解决方法。

这是我们希望尽快改进的地方。这项工作被跟踪为BEAM-53。请在此处查看最新状态。