我正在评估 NiFi 并创建了一个基本的工作流程,它侦听本地目录,应用一些转换,然后将流程放入 kafka,但是在将消息放入 kafka 时,我遇到了错误。
错误跟踪
09:46:35 UTC ERROR1b6ae25f-e517-47d9-90a2-103109a47b90 localhost:10084
PutKafka[id=1b6ae25f-e517-47d9-90a2-103109a47b90] Failed to process session due to org.apache.nifi.processor.exception.FlowFileHandlingException:
StandardFlowFileRecord[uuid=746f505e-54ec-4b9f-a970-1f88cda08a2e,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1455788674669-223, container=default, section=223], offset=0, length=131876],offset=0,name=1_edr_http_EAST.COMPLETED.9,size=131876] is not known in this session (StandardProcessSession[id=134420]):
org.apache.nifi.processor.exception.FlowFileHandlingException: StandardFlowFileRecord[uuid=746f505e-54ec-4b9f-a970-1f88cda08a2e,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1455788674669-223, container=default, section=223], offset=0, length=131876],offset=0,name=1_edr_http_EAST.COMPLETED.9,size=131876] is not known in this session (StandardProcessSession[id=134420])
BasicFieldSplitProcessor 是我的自定义处理器,它是 ReplaceText 的修改版本。
“字段拆分队列”的配置
- FlowFile过期信息:120秒
- 背压对象阈值信息:500000
- 背压数据大小阈值信息:200 MB