Preload Docker Image on AWS Batch Instance

2

Hello, We are using AWS Batch for running Nvidia Cuda based container images hosted on ECR. This containers weight is over 12GB and our AWS Batch instances takes to much time to init (6-7min).

Is there any way to preload the image may be on a custom AMI so the start time is reduced considerably? The AMI currently used has neither access from cloudshell nor SSH.

Thank you!

1개 답변
0

I asked a similar question at re:Invent and found much of the time is cleanup / downloading the image each invocation / start of a job. In the ECS cluster you can change the pull policy to use cached image if available or validate the cached image. This would allow the pull to be FAR faster, at the risk of running an old image if you aggressively cache (if your nodes fully turn off when the batch is done this may be OK). The settings aren't in batch however.

Unless the nodes generally only run one job then terminate then the only difference between caching and preloading would be the time to run the first job.

Good luck, hope it helps.

profile picture
답변함 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인