About how to monitor ephemeral storage usage in Fargate

Question

From Apr 30, 2021, Amazon ECS on AWS Fargate allows you to configure the size of ephemeral storage for Tasks. However, I am consider about ways so that I monitor the usage of ephemeral storage . Is there anyway but use a sidecar container to get the storage capacity and send custom metrics to CloudWatch?

Thank you so much!

Accepted Answer

Hi,

As you've mentioned, there's no native CloudWatch metrics of the ephemeral storage usage, the only workarounds i see would be

- Like you said, a sidecar container to grab the metrics
- Embed in your application the capability to push metric asynchronously to CloudWatch API
- Use an external SSM command to list Fargate tasks and use ECS exec capability to fetch the metric for pushing it to CloudWatch. A bit tricky, i must admit. ( for ref: https://aws.amazon.com/blogs/containers/new-using-amazon-ecs-exec-access-your-containers-fargate-ec2/ )

Answer

You can use the "/" partition to determine the amount of free space left in the Fargate task. There's a plan to publish an ephemeral storage/disk utilization metric via container insights by service team but timeline is not clear at this time.

About how to monitor ephemeral storage usage in Fargate

Relevant questions

Fargate Emphemeral Technology

[Announcement] AWS Lambda now allows customers to configure up to 10 GB of ephemeral storage for Lambda functions

RDS DB migrations using ECS and Fargate

About how to monitor ephemeral storage usage in Fargate

Which role do I have to use for the Fargate tasks on AWS Batch?

Increase EKS Fargate storage

Are there any best practices for sending logs from ECS on EC2, ECS on Fargate and other AWS services such as API GW, load balancers (and more AWS services) to Splunk?

Fargate ephemeral storage 200gb - per task or shared by all tasks?

ARM64 support for Batch jobs on AWS Fargate

Wordpress in Docker container on Fargate