SageMaker serverless inference API

Question

I am working on a project related to serverless inference API. Getting error while calling the CreateEndpoint API, need some reference or sample code related to serverless inference ?

N_Agarwal · Accepted Answer

I would suggest to check the AWS Sagemaker serverless inference link and the blog for an example that has flow for ML model deployment:
https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints.html

https://aws.amazon.com/pt/blogs/machine-learning/deploying-ml-models-using-sagemaker-serverless-inference-preview/

Following are 2 Github repos:

https://github.com/aws/amazon-sagemaker-examples/tree/main/serverless-inference

https://github.com/aws/amazon-sagemaker-examples/blob/main/serverless-inference/Serverless-Inference-Walkthrough.ipynb

Also, check the API reference:

https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreateEndpoint.html

I hope this provides the reference that you are looking for.

SageMaker serverless inference API

Add your answer

Relevant content