How can I use serverless inference with models generated by SageMaker Autopilot?

Question

There are a few articles about deploying SageMaker models to use serverless inference, but I am not clear on how to do that with autopilot models in particular. In other words, I do not understand which steps should be different and how to find information such as what my model ARN is. Thanks.

Answer

At this point there is no direct integration between SageMaker Autopilot and Serverless inferencing. One way to do this take the model.tar.gz from the best training job and deploy it manually as an serverless endpoint. Usually Autopilot uses one of the SageMaker Built in Algorithms  and you will be able to us the specific container to deploy it.

How can I use serverless inference with models generated by SageMaker Autopilot?

Relevanter Inhalt