SageMaker Inference Recommender code

Question

I'm new to Amazon SageMaker Inference Recommender and I'm now trying to use it to find the most cost-effective instance type.

Codes shown in https://docs.aws.amazon.com/sagemaker/latest/dg/inference-recommender-prerequisites.html
and in
https://github.com/aws/amazon-sagemaker-examples/blob/main/sagemaker-inference-recommender/inference-recommender.ipynb 
are different.  As a beginner, which should I follow?

Thanks in advance.

Accepted Answer

Hi, to start with Inference Recommender, there are 4 suggested notebooks at the end of https://docs.aws.amazon.com/sagemaker/latest/dg/inference-recommender.html

They correspond to different use cases (TensorFlow, HuggingFace, etc.)

You should choose the one best matching your own ML environment.

Didier

SageMaker Inference Recommender code

Relevant content