All Content tagged with Amazon SageMaker Clarify
Amazon SageMaker Clarify provides machine learning developers with greater visibility into their training data and models so they can identify and limit bias and explain predictions.
Content language: English
Filter content
Select tags to filter
Sort by
Sort by most recent
11 results
AWS rePost LiveEXPERT
published 2 years ago0 votes318 views
Join us live on [Twitch.tv](https://bit.ly/4anH9WR) on Monday, October 7th to hear us discuss Accelerating Foundation Model Evaluation with Amazon SageMaker Clarify and fmeval
RajEXPERT
published 2 years ago1 votes1.3K views
Large language models (LLMs) can generate biased, toxic, or hallucinated content, making model evaluation crucial. With hundreds of LLMs available, understanding metrics and conducting evaluations is ...
Based on the **Question Answering** section in the [SageMaker Clarify documentation](https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-accuracy-evaluation.html) documentation, I don't see any co...
asked 2 years ago
I have the following code, but it does not work with `model_id='anthropic.claude-3-sonnet-20240229-v1:0'`.
```python
import boto3
import json
from fmeval.constants import MIME_TYPE_JSONLINES
from fm...
asked 2 years ago
Is it possible to use Clarify for explainability/bias detection on a Comprehend model endpoint?
do u know how to edit the metaparameters.json file before running an AutoML job. I can see it come out after an AutoML job is ran in the output s3 bucket. But how do I edit and run it again.
Or is t...
I am working with the SageMaker DeepAR model and facing challenges in generating SHAP values for multiple dynamic features, which are in the form of a 2D array. My model requires additional data such ...
hi,
I have issue while running sagemaker explainability monitoring job , I'm running into below error when i run explainabilty baseline job
Customer Error: cannot reshape array of size 2062 into s...
https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-data-capture-endpoint.html
I have followed the steps mentioned in this and it appears I cannot change the encoding for EndpointOutput in ...
Hello, I get an error in the explicability module of the model registry (see screenshot below).
How can I debug this ? I would like to access logs to investigate this error.
![Screenshot of the Model...
Calling the sagemaker model endpoint with contentType `application/octet-stream` which is also being captured in Data Capture Logs.
What would be the ideal way to transform the data such that model mo...