All Content tagged with Amazon SageMaker Clarify
Amazon SageMaker Clarify provides machine learning developers with greater visibility into their training data and models so they can identify and limit bias and explain predictions.
Content language: English
Select up to 5 tags to filter
Sort by most recent
11 results
EXPERT
published a month ago0 votes85 views
Join us live on [Twitch.tv](https://bit.ly/4anH9WR) on Monday, October 7th to hear us discuss Accelerating Foundation Model Evaluation with Amazon SageMaker Clarify and fmeval
EXPERT
published 2 months ago1 votes164 views
Large language models (LLMs) can generate biased, toxic, or hallucinated content, making model evaluation crucial. With hundreds of LLMs available, understanding metrics and conducting evaluations is ...
Based on the **Question Answering** section in the [SageMaker Clarify documentation](https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-accuracy-evaluation.html) documentation, I don't see any co...
I have the following code, but it does not work with `model_id='anthropic.claude-3-sonnet-20240229-v1:0'`.
```python
import boto3
import json
from fmeval.constants import MIME_TYPE_JSONLINES
from fm...
Is it possible to use Clarify for explainability/bias detection on a Comprehend model endpoint?
do u know how to edit the metaparameters.json file before running an AutoML job. I can see it come out after an AutoML job is ran in the output s3 bucket. But how do I edit and run it again.
Or is t...
I am working with the SageMaker DeepAR model and facing challenges in generating SHAP values for multiple dynamic features, which are in the form of a 2D array. My model requires additional data such ...
hi,
I have issue while running sagemaker explainability monitoring job , I'm running into below error when i run explainabilty baseline job
Customer Error: cannot reshape array of size 2062 into s...
https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-data-capture-endpoint.html
I have followed the steps mentioned in this and it appears I cannot change the encoding for EndpointOutput in ...
Hello, I get an error in the explicability module of the model registry (see screenshot below).
How can I debug this ? I would like to access logs to investigate this error.
![Screenshot of the Model...
Calling the sagemaker model endpoint with contentType `application/octet-stream` which is also being captured in Data Capture Logs.
What would be the ideal way to transform the data such that model mo...