SageMaker Autopilot not generating Model Explainability (SHAP) report


I have run an experiment on SageMaker studio and clicked on the best-trained model when the experiment finished. The right-click option gives me the option "Open in trail details". The new tab (named "Describe Trial Components") has the option/tab "Model Explainability" but does not have any data (SHAP values). Instead of the explainability data for the best model, it has the following instructions for a sample notebook:

Model explainability can be generated when running feature attribution during training. You can view a sample notebook to get started.

Isn't the Model Explainability data automatically created for the best-trained model? Is there an option or config I'm missing?

asked 3 months ago8 views
1 Answer

After much reading and online research, the solution was to shut down SageMaker Studio (File -> Shut Down -> Shut Down All). For some reason, I had to shut it down twice for the model explainability report to show up. Probably some pending updates of SageMaker Studio were not done on my behalf.

answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions