how to choose an instance type for a sagemaker testing/inference?

0

looking at few examples, for training in sagemaker . are there some guidelines based on the model size, data to be trained , what type of instance cpu/gpu to use? also, can one use spot instances ( may be with multiple gpu cores)?

질문됨 2년 전1250회 조회
2개 답변
1

Yes, you can use spot instances. I recommend it, and always run training on spot instances. If you are using the Python SDK, add the following parameters to your Estimator:

       use_spot_instances=True,
       max_run={maximum runtime here},
       max_wait={maximum wait time},
       checkpoint_s3_uri={URI of your bucket and folder },

See the documentation for more details here: https://docs.aws.amazon.com/sagemaker/latest/dg/model-managed-spot-training.html

As far as instance types are concerned, the individual algorithms contain some initial recommendations for instances types: https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html

For example, see the EC2 Instance Recommendation for the Image Classification Algorithm: https://docs.aws.amazon.com/sagemaker/latest/dg/image-classification.html

There was a presentation at re:Invent 2020 - How to choose the right instance type for ML inference: https://www.youtube.com/watch?v=0DSgXTN7ehg

Hope this helps

답변함 2년 전
1

And for the selection of instance type for inference, you might want to look at Amazon SageMaker Inference Recommender:

https://docs.aws.amazon.com/sagemaker/latest/dg/inference-recommender.html

AWS
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠