Does Marketplace Sagemaker Model Package support Async inference

0

I have some questions regarding async inference of sagemaker model packages on aws marketplace

  1. When packaging a model as a sagemaker model package to be offered on marketplace, can it support async inference? In the documentation there is only mention of real-time and batch inference
  2. In the docs it says that before publishing to marketplace one should test the model package for real-time and batch inference first. What if my model doesn't support e.g. real-time inference because processing takes more than 60 seconds. Does one have to offer real-time and/or batch inference?
  3. Can one restrict for what types of deployments a customer uses the model package, e.g. only for async inference or only for real-time inference?
bkoch
demandé il y a 4 mois379 vues
Aucune réponse

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions