SageMaker Neo with SageMaker Serverless Inference possible?

0

Can I use SageMaker Neo to compile my model and then deploy it to SageMaker Serverless inference? Which instance type in Neo should I use in that case?

1 Answer
0

Amazon Sagemaker Neo is basically used for compiling models for specific hardware hence primarily it is focusing on optimising ML models for a specific hardware platform for improved performance and resource utilisation. Deploying this model as serverless in sagemaker echosystem is not possible. Please refer to this document https://docs.aws.amazon.com/sagemaker/latest/dg/neo-deployment-hosting-services.html

AWS
sqavi
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions