1 Respuesta
- Más nuevo
- Más votos
- Más comentarios
0
The G5 instances should be available soon for SageMaker transform as well. In the meantime, you could use SageMaker Training Jobs with custom container to do inference as well. Then you can retrieve the predictions results after unzipping the default output file model.tar.gz which is provided by the SM Training Job. Another alternative is to use the G4DN GPU instances with your SageMaker Batch Transform.
respondido hace 4 años
Contenido relevante
preguntada hace un año
preguntada hace un año
preguntada hace un año
- OFICIAL DE AWSActualizada hace 2 años
- OFICIAL DE AWSActualizada hace 2 años

Thanks for the reply! Any estimate on how soon is soon?, G4s unfortunately won't work as we need bfloat16 compatibility
It has been 8 months. Last I checked, G5 is still not available for transform jobs. When is this planned to roll out?