By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Firehose Ordering

0

Does Firehose guaranties ordering of data in which I have sent?

I am using batch record put (direct put to firehose) from python and converting record to parquet and writing to s3 bucket using dynamic partitioning. Need confirmation on sort order, will it be same or will be changed?

Topics
Analytics
Tags
Amazon Data Firehose
Language
English
Gokul
asked 2 months ago102 views
2 Answers
1

Amazon firehose doesn't guarantee strict ordering of records. If it's essential for your use case, consider handling it at your application level or use in conjunction with Kinesis Data Stream. Refer Amazon Data Firehose Data Delivery for more details.

Hope it helps, comment here if you have additional questions.

Happy to assist.

Abhishek

profile pictureAWS
EXPERT
secondabhi_aws
answered 2 months ago
0

While doing POC with put record order is maintained but while doing it with put order batch order is not maintained. If I use input from Kinesis data stream will order be maintained?

Gokul
answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content