By using AWS re:Post, you agree to the Terms of Use

Is it possible to test locally SageMaker Inference Pipelines?

0

Is it possible to test locally SageMaker Inference Pipelines? I would like to be able to easily troubleshoot and find the appropriate serialization between containers

1 Answer
0
Accepted Answer

If you are referring to using local mode via the SM PySDK, then pipeline deployment is not supported.

As an alternative, given your three inference containers, you could manually run the services locally and then implement a kind of facade function that invokes the three services in pipeline and manages input/output accordingly.

EXPERT
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions