Does Marketplace Sagemaker Model Package support Async inference

0

I have some questions regarding async inference of sagemaker model packages on aws marketplace

  1. When packaging a model as a sagemaker model package to be offered on marketplace, can it support async inference? In the documentation there is only mention of real-time and batch inference
  2. In the docs it says that before publishing to marketplace one should test the model package for real-time and batch inference first. What if my model doesn't support e.g. real-time inference because processing takes more than 60 seconds. Does one have to offer real-time and/or batch inference?
  3. Can one restrict for what types of deployments a customer uses the model package, e.g. only for async inference or only for real-time inference?
bkoch
preguntada hace 4 meses379 visualizaciones
No hay respuestas

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas