Use aws.greengrass.LogManager to upload journald logs not associated to a component?

Question

I have several docker containers running on my Greengrass device that are using the Docker journald logging driver to output logs to journald. These containers run outside of any Greengrass components. Is there a way to use aws.greengrass.LogManager to collect all of the journald output and upload it to CloudWatch?

Or do I need to create a custom component that will collect all of these non-Greengrass logs and upload them separately?

Accepted Answer

Log Manager is configurable to upload any file on disk. It cannot upload from a command, but it can be configured to upload any file pattern. We'd recommend you to configure [LogFileRegex and logFileDirectoryPath](https://docs.aws.amazon.com/greengrass/v2/developerguide/log-manager-component.html#log-manager-component-configuration:~:text=Default%3A%20KB-,logFileDirectoryPath,-(Optional)%20The%20path) of aws.greengrass.LogManager to upload journald logs.

Answer

To collect logs and metrics from other sources than files you can deploy an OpenTelemetry collector container, or FluentBit. Both these approaches can send data to CloudWatch and use the TES credentials provided by Greengrass.

AWS provides a container for FluentBit (https://docs.fluentbit.io/manual/pipeline/outputs/cloudwatch#aws-for-fluent-bit) containing all the necessary plugins.

For instructions on how to run containers images as components in Greengrass and which parameters should be passed, you can refer to the documentation

AWS provides a container for FluentBit (https://docs.fluentbit.io/manual/pipeline/outputs/cloudwatch#aws-for-fluent-bit) containing all the necessary plugins.

For instructions on how to run containers images as components in Greengrass and which parameters should be passed, you can refer to the [documentation](https://docs.aws.amazon.com/greengrass/v2/developerguide/run-docker-container.html)

Use aws.greengrass.LogManager to upload journald logs not associated to a component?

Relevant content