Sagemaker Neo compilation on FreeRTOS enabled devices like Cortex M7 device

Question

Hi, 
I am looking for any support on how to compile and deploy machine learning model to FreeRTOS target devices like Cortex M7. It is clear that compilation jobs are only supported for Windows and Linux platform devices in Sagemaker. Can we customize the target device?

I also need any tutorials on how we can use Amazon FreeRTOS and AWS Green Grass for such devices? Like can we add FreeRTOS device as core Green Grass device? If not, what are the alternative options?

Answer

For the compilation part, please be aware of [STM32Cube.AI](https://www.st.com/content/st_com/en/campaigns/stm32cube-ai.html). You can train your model with SageMaker and export in a format like TensorFlow Lite or ONNX. Then use STM32Cube.AI to generate optimized C code for your MCU. STM32Cube.AI has a CLI, so you should be able to integrate it into a pipeline workflow to automate training all the way through to firmware build and deployment. Deployment could be handled by [AWS IoT Jobs](https://docs.aws.amazon.com/iot/latest/developerguide/iot-jobs.html) or [OTA Updates](https://www.freertos.org/ota/index.html). 
 
I agree with @Cadence_L's answer. For STM32M7, you would use FreeRTOS and not involve Greengrass.

Answer

Hi, FreeRTOS is not a supported Operating System of [SageMaker Neo](https://docs.aws.amazon.com/sagemaker/latest/dg/neo-supported-devices-edge-devices.html).

Greengrass and FreeRTOS are fundamentally different types of products - Amazon FreeRTOS is an operating system that powers embedded Microcontroller Units (MCU) for sensors and smart lightbulbs (with no CPU). Greengrass is AWS's IOT edge computing platform designed for edge devices running on Linux such as Raspberry Pi, IMX6/IMX8 devices and PC's.

You can connect FreeRTOS client devices to Greengrass devices, but you cannot run Greengrass on FreeRTOS. You can read more about this process from [here](https://docs.aws.amazon.com/freertos/latest/userguide/gg-demov2.html) and [here](https://docs.aws.amazon.com/greengrass/v2/developerguide/what-is-iot-greengrass.html).

Sagemaker Neo compilation on FreeRTOS enabled devices like Cortex M7 device

Relevant content