By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

When will g5 instances be available for batch transform?

0

I see the new A10 GPU G5 instances are available for sagemaker training and notebook but not Batch transform, when will it be rolled out to this service?

Topics
Machine Learning & AI
Tags
Amazon SageMakerMachine Learning & AI
Language
English
rePost-User-0853106
asked a year ago672 views
1 Answer
0

The G5 instances should be available soon for SageMaker transform as well. In the meantime, you could use SageMaker Training Jobs with custom container to do inference as well. Then you can retrieve the predictions results after unzipping the default output file model.tar.gz which is provided by the SM Training Job. Another alternative is to use the G4DN GPU instances with your SageMaker Batch Transform.

AWS
Ioan
answered a year ago
  • rePost-User-0853106
    a year ago

    Thanks for the reply! Any estimate on how soon is soon?, G4s unfortunately won't work as we need bfloat16 compatibility

  • Elad
    9 months ago

    It has been 8 months. Last I checked, G5 is still not available for transform jobs. When is this planned to roll out?

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content