What services should I use if I want to do live monitoring the data?

Question

Hello,  
  
I'd like to make an IoT system and do live monitoring of data from the connected things.  
  
For example, I have an array of pressure sensors and want to gather the data from each pressure sensor with 10Hz frequency. I connected the pressure sensor array with my Raspberry Pi and used the embedded C SDK. Finally, I want to monitor the real-time data on a web dashboard and analyze the real time data.  
  
In this case, what services of aws should I use for the gathering, analyzing, and monitoring data?  
I heard that aws rule engine can be used to do those tasks at once, but have no idea what and how services should be used.  
  
Hope to hear your suggestions.   
  
Thank you.

Answer

Thanks for a great question,  
  
You should send the data over MQTT to IoT Core \[1] and yes, use Rules Engine \[2] to direct the messages to the appropriate components.  
  
You absolutely could configure an action in Rules Engine to send the data to IoT Analytics and then explore and visualize \[3] the datasets with Amazon Quicksight however if you really need the data in real-time, you may want to consider still sending the data to IoT Analytics, but using a Lambda function to route some of the traffic you are interested in to CloudWatch so that you can see it in real time and set alarms etc with CloudWatch \[4]. This can give you a great mix of some real-time visualization combined with longer term storage and analysis with IoT Analytics.  
  
Another alternative from Rules Engine would be to route the data to Elastic Search \[5] which has the built in Visualization / Dashboarding options from Kibana. Depending on your analysis requirements this can work well too, but it can be harder to operationalize your analysis (make it easy to do on a recurring schedule) which is where IoT Analytics can be helpful. IoT Analytics also has some powerful integrations with SageMaker and Jupyter Notebooks which make more advanced analysis and visualizations possible.  
  
Hope some of these references help. I note that you want to gather the data at 10Hz - whilst it's totally fine to send all of that to the cloud, you may want to consider maintaining a moving average (or min / max for the time period) on the device and only sending data to the cloud at a lower frequency.  
  
Roger  
  
\[1] https://aws.amazon.com/iot-core/features/  
\[2] https://docs.aws.amazon.com/iot/latest/developerguide/iot-rules.html  
\[3] https://docs.aws.amazon.com/iotanalytics/latest/userguide/getting-started.html#aws-iot-analytics-explore-data  
\[4] https://aws.amazon.com/blogs/iot/real-time-metrics-with-aws-iot-analytics-and-amazon-cloudwatch/  
\[5] https://aws.amazon.com/elasticsearch-service/

Answer

Thanks for your great and prompt reply. I will work with the IoT Analytics first.  
  
Regards,  
Geon-Hong

What services should I use if I want to do live monitoring the data?

相關內容