AWS Bedrock - Claude Model invocations are raising Exception

0

Claude Model invocations are raising the following exception:

Aws::BedrockRuntime::Errors::ModelErrorException: The system encountered an unexpected error during processing. Try your request again.

This error only started today, and appears to be inconsistently being raised, regardless of input/input length.

  • The region is us-east-1.
  • Retry appears work sometimes, doesn't most of the time.
  • Model ID: anthropic.claude-3-haiku-20240307-v1:0
  • This also appears to be an issue while testing knowledge bases (RAG) along with model selection (Generate Responses option selected) within the AWS Console (Bedrock)

3 Answers
1

You can attempt to troubleshoot the issue by using the Amazon Bedrock API, construct a POST request to the endpoint https://runtime.bedrock.{region}.amazonaws.com/agent/{agentName}/runtime/retrieveAndGenerate, where {region} is your AWS region and {agentName} is the name of your Bedrock agent. The request body should follow the provided syntax, filling in the necessary fields such as knowledgeBaseId, modelArn, and text for the input prompt.

Something like this:

curl -X POST \
  https://runtime.bedrock.us-east-1.amazonaws.com/agent/{yourAgent}/runtime/retrieveAndGenerate \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer YOUR_ACCESS_TOKEN' \
  -d '{
        "input": {
            "text": "What is the capital of Dominican Republic?"
        },
        "retrieveAndGenerateConfiguration": {
            "knowledgeBaseConfiguration": {
                "generationConfiguration": {
                    "promptTemplate": {
                        "textPromptTemplate": "The answer is:"
                    }
                },
                "knowledgeBaseId": "YOUR_KNOWLEDGE_BASE_ID",
                "modelArn": "YOUR_MODEL_ARN",
                "retrievalConfiguration": {
                    "vectorSearchConfiguration": {
                        "numberOfResults": 5
                    }
                }
            },
            "type": "YOUR_TYPE"
        },
        "sessionId": "YOUR_SESSION_ID"
      }'

I haven't attempted this yet, but it could help determine whether the issue is isolated to the AWS console or if it's related to the API model anthropic.claude-3-sonnet-20240229-v1:0.

profile picture
EXPERT
answered a month ago
1

This was also happening with other models, however, appears to have resolved on its own now.

Julien
answered a month ago
1

Doesn't this happen even now?

answered 21 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions