How to debug the explicability module of a model in the registry ?

0

Hello, I get an error in the explicability module of the model registry (see screenshot below). How can I debug this ? I would like to access logs to investigate this error.

Screenshot of the Model Registry in Sagemaker Studio

HaPo
已提問 1 年前檢視次數 310 次
2 個答案
0

Customer needs to provide the S3uri for Clarify Explainability json in CreateModelPackage ModelMetrics

   "ModelMetrics": {
        "ModelQuality": {
            "Statistics": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********/V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/modelqualitycheckstep/statistics.json"
            },
            "Constraints": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********//V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/modelqualitycheckstep/constraints.json"
            }
        },
        "ModelDataQuality": {
            "Statistics": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********//V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/dataqualitycheckstep/statistics.json"
            },
            "Constraints": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********//V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/dataqualitycheckstep/constraints.json"
            }
        },
        "Bias": {
            "Report": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********//V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/modelbiascheckstep/analysis.json"
            },
            "PreTrainingReport": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********/V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/databiascheckstep/analysis.json"
            },
            "PostTrainingReport": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********/V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/modelbiascheckstep/analysis.json"
            }
        },
        "Explainability": {
            "Report": {
                "ContentType": "application/json",
                "S3Uri": "s3://sagemaker-project-p-*********/V796221526-p-pwcowxgrrfdt/5qo6ezikmux3/modelexplainabilitycheckstep/analysis.json"
            }
        }
    }

The Studio looks for the analysis.json(S3Uri) file in particular in the Explainability -> Report object and renders the report for the data in the analysis.json file.

AWS
已回答 1 年前
-1
已回答 1 年前
  • Thank for your answer but this Stackoverflow discussion is not about the same subject. I know how to get the importance of my model features from a notebook but in my case it is a custom model (catboost) that I save in the model registry while running a sagemaker pipeline. I can't find in the documentation the specification needed to display the feature importance when using AWS Clarify and I can't find the associated logs.

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南