Kinesis Data Analytics record ordering

0

if I push IoT Core data to Kinesis Analytics as stream, how possible is to apply order by query to streaming data because you don't have complete data to call "order by" ? My goal is pushing IoT Core data and push them to Analytics in order to put them in sequence and push to AppSync to broadcast to subscribers. This Way I can visualize the data flow in time series and sequential in real time. Thanks

2 Risposte
0

AWS IoT does not guarantee the order of received messages :

The message broker doesn't guarantee the order in which messages and ACK are received.

Therefore, to use the order by clause in Amazon Kinesis Analytics, you need to have an attribute in the MQTT payload that you can order on. Ideally it's your device that adds it e.g a sequence number or timestamp.

profile pictureAWS
ESPERTO
Jan_B
con risposta 2 anni fa
0

Definitely I will have attribute for order by, but my point if you don't have all of the record order by will miss some of them, unless you wait all messages received and run order by

con risposta 2 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande