SageMaker Autopilot not generating Model Explainability (SHAP) report

0

I have run an experiment on SageMaker studio and clicked on the best-trained model when the experiment finished. The right-click option gives me the option "Open in trail details". The new tab (named "Describe Trial Components") has the option/tab "Model Explainability" but does not have any data (SHAP values). Instead of the explainability data for the best model, it has the following instructions for a sample notebook:

Model explainability can be generated when running feature attribution during training. You can view a sample notebook to get started.

Isn't the Model Explainability data automatically created for the best-trained model? Is there an option or config I'm missing?

Stavros
gefragt vor 2 Jahren310 Aufrufe
1 Antwort
0

After much reading and online research, the solution was to shut down SageMaker Studio (File -> Shut Down -> Shut Down All). For some reason, I had to shut it down twice for the model explainability report to show up. Probably some pending updates of SageMaker Studio were not done on my behalf.

Stavros
beantwortet vor 2 Jahren
  • I Shut Down the Studio Kernel multiple times. It didn't resolve the problem for me. I check the output folder in S3 and it doesn't contain explainability report either.

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen