Kinesis Data Analytics record ordering

0

if I push IoT Core data to Kinesis Analytics as stream, how possible is to apply order by query to streaming data because you don't have complete data to call "order by" ? My goal is pushing IoT Core data and push them to Analytics in order to put them in sequence and push to AppSync to broadcast to subscribers. This Way I can visualize the data flow in time series and sequential in real time. Thanks

2 réponses
0

AWS IoT does not guarantee the order of received messages :

The message broker doesn't guarantee the order in which messages and ACK are received.

Therefore, to use the order by clause in Amazon Kinesis Analytics, you need to have an attribute in the MQTT payload that you can order on. Ideally it's your device that adds it e.g a sequence number or timestamp.

profile pictureAWS
EXPERT
Jan_B
répondu il y a 2 ans
0

Definitely I will have attribute for order by, but my point if you don't have all of the record order by will miss some of them, unless you wait all messages received and run order by

répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions