Does AWS Batch support EC2 Spot stop/start and hibernation
Does AWS Batch have support for EC2 spot stop/start and hibernation options to handle interruptions? The options are documented here: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-interruptions.html
But I am unable to find reference of whether AWS Batch can support this. From my understanding, if a Spot instance is terminated, AWS Batch retries the job from the start.
- 最新
- 投票最多
- 评论最多
No, AWS Batch does not support EC2 spot stop/start and hibernation options with a managed compute environment (CE). If a Spot instance is terminated, AWS Batch will retry the job (from the start) per your retry strategy defined in your job definition. It is possible for your job to resume progress if it has checkpointing built-in and you save your data somewhere that can be accessed again (e.g. EFS).
You can use hibernation with unmanaged CE. However, since it is not officially supported, your job might be “stuck” when Spot reclaims your instance and the instance goes into hibernation. This job will continue to be in “running” state and stay at the top of your job queue, preventing other jobs from running if you have hit your max vCPU limit in your CE.
相关内容
AWS 官方已更新 1 年前- AWS 官方已更新 7 个月前
- AWS 官方已更新 1 年前
- AWS 官方已更新 2 年前
hi, just checking in - is this answer still up-to-date 5 years later? we are wondering if hibernation-based spot instances can be used for our long-running batch jobs to reduce the cost :.)