SageMaker Neo with SageMaker Serverless Inference possible?

Question

Can I use SageMaker Neo to compile my model and then deploy it to SageMaker Serverless inference? Which instance type in Neo should I use in that case?

Answer

Amazon Sagemaker Neo is basically used for compiling models for specific hardware hence primarily it is focusing on optimising ML models for a specific hardware platform for improved performance and resource utilisation.  Deploying this model as serverless in sagemaker echosystem is not possible. 
Please refer to this document https://docs.aws.amazon.com/sagemaker/latest/dg/neo-deployment-hosting-services.html

SageMaker Neo with SageMaker Serverless Inference possible?

Relevanter Inhalt