Passer au contenu
En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post
À propos de re:Post

[Feature Request] Serverless Inference with VPC Config

1

I would like to use a Sagemaker Model with a custom VPC Configuration, which is currently not possible with Serverless Inference. Is this feature planned? More generally: Is there a roadmap somewhere for Serverless Inference?

Sujets
Apprentissage automatique et IA
Balises
Amazon SageMaker
Langue
English

demandé il y a 4 ans1,4 k vues

3 réponses
0

Any updates on this?

Btw, you should add a warning to the documentation of Model.deploy() here: https://sagemaker.readthedocs.io/en/v2.169.0/api/inference/model.html as I've been getting a ValidationException and I've been trying to debug it for hours, without a clue for why it's failing. I am also using a VPC config. Honestly AWS, fix your damn documentation.

répondu il y a 3 ans

  • Richard
    il y a 3 ans

    Hi! We also lost several hours because of incomplete and misleading documentation. What we ended up doing is to create a VPC network for our Redis Cluster which Sagemaker was not part of and handled the caching in the API calling the Sagemaker endpoint. Maybe you can use a similar approach.

0

SageMaker Serverless Inference is currently in preview and VPC support is not available but as the feature you are asking for is an important one and is on the roadmap( unfortunately I cannot share the exact details of the timelines here)

AWS

répondu il y a 4 ans

0

How long will this be on preview. I hope when it comes out, it will have support for VPC

répondu il y a 3 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Contenus pertinents