Cannot select g4dn instances for marketplace model package transform jobs

Question

I am creating an marketplace model package. For implementation reasons i would like to support only T4 gpus for batch transform jobs (G4dn machines). I already checked that G4dn machines are available for batch transform jobs, but when creating the model package via console, under the "Supported instance types for batch transform jobs" field, i don´t see the g4dn machines as options, only the p2 and p3 line of machines are listed under "accelerated computing".

Am i missing something? are g4dn machines not supported for markplace models even though they are supported for batch transform jobs?

Answer

It appears that while AWS SageMaker supports ml.G4dn instances for batch transform and processing jobs, which include the latest generation NVIDIA T4 Tensor Core GPUs, these instances might not be directly selectable or visible when creating a Marketplace model package through the AWS console. This could potentially be a limitation or configuration issue specific to the Marketplace settings or the SageMaker console interface.

For creating a Marketplace model package, AWS SageMaker requires you to specify supported instance types for batch transform jobs during the package creation process. It's possible that the list of instance types displayed in the console is curated or limited based on certain criteria set by AWS, which might not include all instance types supported for general SageMaker operations at this time.

Cannot select g4dn instances for marketplace model package transform jobs

Relevant content