SageMaker Autopilot not generating Model Explainability (SHAP) report

0

I have run an experiment on SageMaker studio and clicked on the best-trained model when the experiment finished. The right-click option gives me the option "Open in trail details". The new tab (named "Describe Trial Components") has the option/tab "Model Explainability" but does not have any data (SHAP values). Instead of the explainability data for the best model, it has the following instructions for a sample notebook:

Model explainability can be generated when running feature attribution during training. You can view a sample notebook to get started.

Isn't the Model Explainability data automatically created for the best-trained model? Is there an option or config I'm missing?

Stavros
demandé il y a 2 ans305 vues
1 réponse
0

After much reading and online research, the solution was to shut down SageMaker Studio (File -> Shut Down -> Shut Down All). For some reason, I had to shut it down twice for the model explainability report to show up. Probably some pending updates of SageMaker Studio were not done on my behalf.

Stavros
répondu il y a 2 ans
  • I Shut Down the Studio Kernel multiple times. It didn't resolve the problem for me. I check the output folder in S3 and it doesn't contain explainability report either.

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions