Amazon SageMaker Built-in algorithms and Spot checkpointing

0

Which Amazon SageMaker built-in algorithms support checkpointing? In the documentation it says that:

SageMaker built-in algorithms and marketplace algorithms that do not checkpoint are currently limited to a MaxWaitTimeInSeconds of 3600 seconds (60 minutes).

However, in the algorithms I don't find any pointer to "checkpoint" or "spot". Can you help me out?

AWS
asked 4 years ago345 views
1 Answer
0
Accepted Answer

This is the best resource that I've found to clarify this:

https://aws.amazon.com/blogs/aws/managed-spot-training-save-up-to-90-on-your-amazon-sagemaker-training-jobs/

Built-in algorithms: computer vision algorithms support checkpointing (Object Detection, Semantic Segmentation, and very soon Image Classification). As they tend to train on large data sets and run for longer than other algorithms, they have a higher likelihood of being interrupted. Other built-in algorithms do not support checkpointing for now.

Also:

Please note that TensorFlow uses checkpoints by default. For other frameworks, you’ll find examples in our sample notebooks and in the documentation.

answered 4 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions