SageMaker Autopilot not generating Model Explainability (SHAP) report

0

I have run an experiment on SageMaker studio and clicked on the best-trained model when the experiment finished. The right-click option gives me the option "Open in trail details". The new tab (named "Describe Trial Components") has the option/tab "Model Explainability" but does not have any data (SHAP values). Instead of the explainability data for the best model, it has the following instructions for a sample notebook:

Model explainability can be generated when running feature attribution during training. You can view a sample notebook to get started.

Isn't the Model Explainability data automatically created for the best-trained model? Is there an option or config I'm missing?

Stavros
preguntada hace 2 años310 visualizaciones
1 Respuesta
0

After much reading and online research, the solution was to shut down SageMaker Studio (File -> Shut Down -> Shut Down All). For some reason, I had to shut it down twice for the model explainability report to show up. Probably some pending updates of SageMaker Studio were not done on my behalf.

Stavros
respondido hace 2 años
  • I Shut Down the Studio Kernel multiple times. It didn't resolve the problem for me. I check the output folder in S3 and it doesn't contain explainability report either.

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas