Kinesis Data Analytics record ordering

0

if I push IoT Core data to Kinesis Analytics as stream, how possible is to apply order by query to streaming data because you don't have complete data to call "order by" ? My goal is pushing IoT Core data and push them to Analytics in order to put them in sequence and push to AppSync to broadcast to subscribers. This Way I can visualize the data flow in time series and sequential in real time. Thanks

2 Antworten
0

AWS IoT does not guarantee the order of received messages :

The message broker doesn't guarantee the order in which messages and ACK are received.

Therefore, to use the order by clause in Amazon Kinesis Analytics, you need to have an attribute in the MQTT payload that you can order on. Ideally it's your device that adds it e.g a sequence number or timestamp.

profile pictureAWS
EXPERTE
Jan_B
beantwortet vor 2 Jahren
0

Definitely I will have attribute for order by, but my point if you don't have all of the record order by will miss some of them, unless you wait all messages received and run order by

beantwortet vor 2 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen