Sagemaker training instance

Question

I have a doubt with choosing instance for training job in sagemaker. Is ml.m5.2xlarge with count as 2 and ml.m5.4xlarge are same ?

I would like to know if there is any best practice guide to choose the instance for training in sagemaker.

Thank you 🙂

Answer

Hello,

The question is quite broad since there will be multiple factors to consider.

Here is the pricing range provided. You can calculate the same and find out if using 2ml.m5.2xlarge with count as 2 OR ml.m5.4xlarge would be better for your use-case.

Pricing- https://aws.amazon.com/sagemaker/pricing/

You can refer to the training best practice #6 and find out what is the specification and which instance would you choose from Compute/Memory Optimized image or the Standard one.

Here is a 3rd party link provided that would could be helpful, however it is not verified by AWS and is based on the research that I found on the internet based on what to consider while choosing a training instance.

Link- https://datachef.co/blog/how-to-choose-the-best-training-instance-on-sagemaker/

Answer

Hello, to help on the experimentation, you can create a pipeline and run multiple training jobs simultaneously with different instance configurations https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-multi-model. Hope this helps!

Sagemaker training instance

Relevant content