Using Launch Template with custom AMI for AWS Batch

0

We created an AMI with a preloaded docker image and ECS agent configurations (under /etc/ecs/ecs.config) in hopes to bring our AWS Batch execution time down. Although the pull time has been eliminated, the job execution time has doubled (from our prod jobs that still pull the docker image).

Has anyone experienced this issue or have guidance on how to debug?

asked 2 months ago59 views
2 Answers
0

I would like to have more context of the issue.

Like, for how long your job run generally? Also, caching container image should not hamper the execution time. So to debug such issue, i would suggest you add timestamp entries in logs to check which part of application code is taking more time to execute.

And how much image pull time is reduced after caching image? you can confirm the same via check corresponding ecs task details which will have image pull time details.

SUPPORT ENGINEER
answered 2 months ago
0

For now we have one EC2 instance always running to mitigate the cold start problem (EC2 instance spin-up + docker image pull). Jobs run for ~3:30min, ideally image pull time is eliminated after caching. Also, we've reduced the image size from 16GB to 4GB.

answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions