0

我是凯洛的新手

我在 Hortonworks HDP 2.5 的测试集群上手动部署了 Kylo，并重用了我的 Nifi 实例。

我按照摄取教程（用户注册）制作了一个示例提要，并且成功了。

但是，当我将示例数据文件放在 /var/dropzone/ 中时，该文件被删除（假设它被 Nifi 提取和读取）并且提要在过去 18 小时内运行。对于一个小文件来说似乎太多了。

我查看了 nifi-app.log，只能发现 belo 错误，这当然没有帮助

2017-05-29 09:38:41,045 INFO [Timer-Driven Process Thread-2] c.t.nifi.v2.common.FeedProcessor Resolving id ed2033a4-4bd5-4ea1-b9bc-2a48d69afef9 for feed /
2017-05-29 09:38:41,046 INFO [Timer-Driven Process Thread-5] c.t.nifi.v2.common.FeedProcessor Resolving ID for feed /
2017-05-29 09:38:41,048 INFO [Timer-Driven Process Thread-4] o.a.n.processors.standard.LogAttribute LogAttribute[id=01a8415a-0b38-14f2-8190-30f49a59ce2c] logging for flow file StandardFlowFileRecord[uuid=545885ac-eaa9-4387-b02a-a127594adc32,claim=,offset=0,name=19269191970708822,size=0]
--------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
        Value: 'Mon May 29 09:38:40 AST 2017'
Key: 'lineageStartDate'
        Value: 'Mon May 29 09:38:40 AST 2017'
Key: 'fileSize'
        Value: '0'
FlowFile Attribute Map Content
Key: 'feedId'
        Value: 'ed2033a4-4bd5-4ea1-b9bc-2a48d69afef9'
Key: 'filename'
        Value: '19269191970708822'
Key: 'path'
        Value: './'
Key: 'uuid'
        Value: '545885ac-eaa9-4387-b02a-a127594adc32'

2017-05-29 09:38:41,088 INFO [Timer-Driven Process Thread-8] c.t.n.p.cache.FeedFlowFileCacheUtil Ending the Job for Feed null and flowfile: 47e9d23c-1b7f-4d64-8b2c-feb9e944838f.  Event: ProvenanceEventRecordDTO{eventId=16975572, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=47e9d23c-1b7f-4d64-8b2c-feb9e944838f, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975572, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=47e9d23c-1b7f-4d64-8b2c-feb9e944838f, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975573, processorName=Load High Watermark, componentId=01a84157-0b38-14f2-d63d-c41fbd9c38a3, flowFile=574f778e-40f1-4fd4-863a-6d19613c127e, previous=null, eventType=CREATE, eventDetails=null, isEndOfJob=false, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 INFO [Timer-Driven Process Thread-8] c.t.n.p.cache.FeedFlowFileCacheUtil Ending the Job for Feed null and flowfile: 574f778e-40f1-4fd4-863a-6d19613c127e.  Event: ProvenanceEventRecordDTO{eventId=16975574, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=574f778e-40f1-4fd4-863a-6d19613c127e, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975574, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=574f778e-40f1-4fd4-863a-6d19613c127e, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975575, processorName=Load High Watermark, componentId=01a84157-0b38-14f2-d63d-c41fbd9c38a3, flowFile=2236a2a0-27e7-4f7d-8fcf-79441fe43e86, previous=null, eventType=CREATE, eventDetails=null, isEndOfJob=false, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 INFO [Timer-Driven Process Thread-8] c.t.n.p.cache.FeedFlowFileCacheUtil Ending the Job for Feed null and flowfile: 2236a2a0-27e7-4f7d-8fcf-79441fe43e86.  Event: ProvenanceEventRecordDTO{eventId=16975576, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=2236a2a0-27e7-4f7d-8fcf-79441fe43e86, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975576, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=2236a2a0-27e7-4f7d-8fcf-79441fe43e86, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}

以下是 nifi 进程。我在这里看的不多。在此处输入图像描述

任何想法？

4

1 回答 1

0

听起来文件可能卡在了 NiFi 中。请进入 NiFi 并查看是否可以找到出现故障或停止的处理器。

于 2017-05-30T18:34:55.343 回答