Sagemaker training instance

Hello,

The question is quite broad since there will be multiple factors to consider.

Here is the pricing range provided. You can calculate the same and find out if using 2ml.m5.2xlarge with count as 2 OR ml.m5.4xlarge would be better for your use-case.

Pricing- https://aws.amazon.com/sagemaker/pricing/

You can refer to the training best practice #6 and find out what is the specification and which instance would you choose from Compute/Memory Optimized image or the Standard one.

Here is a 3rd party link provided that would could be helpful, however it is not verified by AWS and is based on the research that I found on the internet based on what to consider while choosing a training instance.

Link- https://datachef.co/blog/how-to-choose-the-best-training-instance-on-sagemaker/

Hello, to help on the experimentation, you can create a pipeline and run multiple training jobs simultaneously with different instance configurations https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-multi-model. Hope this helps!