Firehose only delivers 99% of records to s3

0

I have set up a firehose (direct put) to deliver messages to a s3 bucket.

Unfortunately, regardless of the number of message to be delivery, Firehose always delivers n-500 messages.

In screenshot attached, we can see what happens when attempting to deliver 500000 records, it gets stuck at 4995000. Same happens when I attempt to deliver 200000 messages, it gets stuck at 199500

I have replaced the firehose, change the instances, even tried to do the same from different aws accounts, but the result is the same.

Anyone who could shed some light on this would be very much appreciated.

Sincerley,

Josep Maria

Edited by: JosepMaria on Sep 27, 2020 5:53 AM

Edited by: JosepMaria on Sep 27, 2020 5:57 AM

질문됨 4년 전243회 조회
1개 답변
1
수락된 답변

Modify code by adding :

"initialPositionon":"START_OF_FILE",

답변함 3년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠