AWS Rekognition and Sagemaker Running Local to automate annotation base on video streaming


Hi everyone, I have a project in manufacturing area that I would like to improve by implementing computed vision capability. I already work with AWS services, but I still have no experience with Rekognition and Sagemaker, so I will explain my application below and would like to know if it is possible to make and what are the key point I need to put my attention and study. Today in a manufacturing plant, anytime a machine stops, the worker annotates the downtime cause on a tablet(running my app) with predefined options. I'd like to implement computed vision to automate this annotation, or suggest the most probable cause. I'm expecting a way for the application to auto train and improve itself given the historical data composed by: downtime cause annotated by operator + period of time when that downtime occurred + video. I plan to run on an edge through greengrass with a tpu processor.

Thanks in advance.

2 Answers

Amazon Monitron could be a good addition to consider in this scenario. Monitron is an IoT platform that includes a suite of sensors, gateways, and machine learning algorithms that help industrial customers monitor the health and performance of their equipment. Monitron can be used to automatically detect equipment anomalies and predict when maintenance is required. There's actually also a whole suite of other solutions and services for industrial.

In your case, Monitron could be a complementary solution to implement along with Amazon Rekognition and SageMaker. You could use Monitron to collect sensor data and use Rekognition to process the video data and SageMaker to train the machine learning models. Or you could you use Monitron by itself, as it is an end-to-end system.

A knowledge of AWS services such as Amazon Rekognition, SageMaker, and Greengrass would help. For studying, has some good hands-on training on some of these topics. It would also be helpful to study Monitron in more detail and understand how to integrate it with the other AWS services you plan to use.

Here's a blog that talks about using Monitron to reduce unplanned downtime:

I would also recommend you also get in touch with your AWS account team. They may be able to provide some time with a Solutions Architect to dive a little deeper into helping you think through the architecture.

answered 2 months ago

If you can have connectivity then Amazon Rekognition Photo Custom Labels can be a good start, by sampling a live video stream for annotation event - this would be the simplest solution but with less flexibility in terms of personalization of your model.

Otherwise, if you want what your model to work offline or you want to train a custom Computer Vision model, the Greengrass for the inference but leverage the power of the SageMaker + GPU ML instances for training your model in cloud. For the later approach, please try the Quick Starts in SageMaker Studio that you can try for Image Classification sample notebook: Note that in this case you can leverage the SageMaker framework to train faster, optimize the hyperparameters using build-in tools like "hyperparameters tuning" feature:

A 3rd option could be Amazon Lookout for Vision agent for Greengrass if you want only to detect a defect:

profile picture
answered a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions