All Content tagged with Amazon SageMaker Clarify

Amazon SageMaker Clarify provides machine learning developers with greater visibility into their training data and models so they can identify and limit bias and explain predictions.

Content language: English

Select up to 5 tags to filter
Sort by most recent
11 results
Join us live on [Twitch.tv](https://bit.ly/4anH9WR) on Monday, October 7th to hear us discuss Accelerating Foundation Model Evaluation with Amazon SageMaker Clarify and fmeval
profile pictureAWS
EXPERT
published 2 months ago1 votes164 views
Large language models (LLMs) can generate biased, toxic, or hallucinated content, making model evaluation crucial. With hundreds of LLMs available, understanding metrics and conducting evaluations is ...
Based on the **Question Answering** section in the [SageMaker Clarify documentation](https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-accuracy-evaluation.html) documentation, I don't see any co...
1
answers
0
votes
138
views
AWS
asked 4 months ago
I have the following code, but it does not work with `model_id='anthropic.claude-3-sonnet-20240229-v1:0'`. ```python import boto3 import json from fmeval.constants import MIME_TYPE_JSONLINES from fm...
1
answers
0
votes
123
views
AWS
asked 4 months ago
Is it possible to use Clarify for explainability/bias detection on a Comprehend model endpoint?
1
answers
0
votes
258
views
asked 8 months ago
do u know how to edit the metaparameters.json file before running an AutoML job. I can see it come out after an AutoML job is ran in the output s3 bucket. But how do I edit and run it again. Or is t...
0
answers
0
votes
118
views
asked 9 months ago
I am working with the SageMaker DeepAR model and facing challenges in generating SHAP values for multiple dynamic features, which are in the form of a 2D array. My model requires additional data such ...
1
answers
0
votes
372
views
asked a year ago
hi, I have issue while running sagemaker explainability monitoring job , I'm running into below error when i run explainabilty baseline job Customer Error: cannot reshape array of size 2062 into s...
1
answers
0
votes
434
views
asked 2 years ago
https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-data-capture-endpoint.html I have followed the steps mentioned in this and it appears I cannot change the encoding for EndpointOutput in ...
1
answers
0
votes
384
views
asked 2 years ago
Hello, I get an error in the explicability module of the model registry (see screenshot below). How can I debug this ? I would like to access logs to investigate this error. ![Screenshot of the Model...
2
answers
0
votes
403
views
asked 2 years ago
Calling the sagemaker model endpoint with contentType `application/octet-stream` which is also being captured in Data Capture Logs. What would be the ideal way to transform the data such that model mo...
1
answers
0
votes
623
views
asked 2 years ago
  • 1
  • 12 / page