Does Marketplace Sagemaker Model Package support Async inference

0

I have some questions regarding async inference of sagemaker model packages on aws marketplace

  1. When packaging a model as a sagemaker model package to be offered on marketplace, can it support async inference? In the documentation there is only mention of real-time and batch inference
  2. In the docs it says that before publishing to marketplace one should test the model package for real-time and batch inference first. What if my model doesn't support e.g. real-time inference because processing takes more than 60 seconds. Does one have to offer real-time and/or batch inference?
  3. Can one restrict for what types of deployments a customer uses the model package, e.g. only for async inference or only for real-time inference?
bkoch
asked 4 months ago375 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions