Greengrass Stream Manager payload size

Question

According to Stream Manager [SDK][1], the segment size can be between 1KB and 2GB. However, IoT Analytics and Kinesis support payloads of up to 128KB and 1MB respectively. Does Stream Manager chunk the data when exporting to a destination and if so, is this done in a predictable manner?

[1]: https://aws.github.io/aws-greengrass-core-sdk-python/_apidoc/greengrasssdk.stream_manager.data.html#greengrasssdk.stream_manager.data.MessageStreamDefinition.stream_segment_size

Accepted Answer

As far as I understand the segment size has nothing to do with the amount of data that is exported to an endpoint. The stream manager itself respects the limit of the endpoints. For Kinesis for example it has a max payload size of 1MB and batch size of 500.

I don't know if stream exporter splits up larger messages or if the will result in an export error.

Greengrass Stream Manager payload size

Relevant content