0

I have built a Kinesis Firehose stream to push data into redshift and am trying to push data from an EC2 instance using kinesis agent.

Firehose Stream is able to parse the records but not identify the firehose streams am getting the following java error.

com.amazon.kinesis.streaming.agent.tailing.AsyncPublisher 
[ERROR] AsyncPublisher[kinesis:csvtoredshiftstream:/tmp/redshift.log*]:RecordBuffer
(id=2,records=2,bytes=45) Retriable send error (com.amazonaws.services.kinesis.model.ResourceNotFoundException: 
Stream csvtoredshiftstream under account xyz not found. 
(Service: AmazonKinesis; Status Code: 400; 
Error Code: ResourceNotFoundException; 
Request ID: f4a63623-9a15-b2f8-a597-13b478c81bbc)). Will retry.

Request your pointers to identify and resolve the issue.

Regards, Srivignesh KN

4

1 回答 1

1

谢谢@彼得，

  1. 通过以以下方式在 agent.json 中为 firehose 事件指定输入，我能够克服错误。{“cloudwatch.emitMetrics”：真，“kinesis.endpoint”：“”，“firehose.endpoint”：“firehose.us-west-2.amazonaws.com”，“流”：[{“filePattern”：“/ tmp/s3streaming. ", "deliveryStream": "S3TestingStream", "partitionKeyOption": "RANDOM" }, { "filePattern": "/tmp/app.log ", "deliveryStream": "yourdeliverystream" } ] } –

  2. 此外，要使 Kinesis Streams 按预期工作，还需要在与 Streams 相同的区域中创建 S3 存储桶。

如果 Stream 在 West-2 区域创建，S3 存储桶也应该在同一区域创建。

谢谢和问候， Srivignesh KN

于 2017-03-05T21:08:20.073 回答