Does Marketplace Sagemaker Model Package support Async inference

0

I have some questions regarding async inference of sagemaker model packages on aws marketplace

  1. When packaging a model as a sagemaker model package to be offered on marketplace, can it support async inference? In the documentation there is only mention of real-time and batch inference
  2. In the docs it says that before publishing to marketplace one should test the model package for real-time and batch inference first. What if my model doesn't support e.g. real-time inference because processing takes more than 60 seconds. Does one have to offer real-time and/or batch inference?
  3. Can one restrict for what types of deployments a customer uses the model package, e.g. only for async inference or only for real-time inference?
bkoch
gefragt vor 4 Monaten379 Aufrufe
Keine Antworten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen