AWS Bedrock - Claude Model invocations are raising Exception

0

Claude Model invocations are raising the following exception:

Aws::BedrockRuntime::Errors::ModelErrorException: The system encountered an unexpected error during processing. Try your request again.

This error only started today, and appears to be inconsistently being raised, regardless of input/input length.

  • The region is us-east-1.
  • Retry appears work sometimes, doesn't most of the time.
  • Model ID: anthropic.claude-3-haiku-20240307-v1:0
  • This also appears to be an issue while testing knowledge bases (RAG) along with model selection (Generate Responses option selected) within the AWS Console (Bedrock)

3回答
2

You can attempt to troubleshoot the issue by using the Amazon Bedrock API, construct a POST request to the endpoint https://runtime.bedrock.{region}.amazonaws.com/agent/{agentName}/runtime/retrieveAndGenerate, where {region} is your AWS region and {agentName} is the name of your Bedrock agent. The request body should follow the provided syntax, filling in the necessary fields such as knowledgeBaseId, modelArn, and text for the input prompt.

Something like this:

curl -X POST \
  https://runtime.bedrock.us-east-1.amazonaws.com/agent/{yourAgent}/runtime/retrieveAndGenerate \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer YOUR_ACCESS_TOKEN' \
  -d '{
        "input": {
            "text": "What is the capital of Dominican Republic?"
        },
        "retrieveAndGenerateConfiguration": {
            "knowledgeBaseConfiguration": {
                "generationConfiguration": {
                    "promptTemplate": {
                        "textPromptTemplate": "The answer is:"
                    }
                },
                "knowledgeBaseId": "YOUR_KNOWLEDGE_BASE_ID",
                "modelArn": "YOUR_MODEL_ARN",
                "retrievalConfiguration": {
                    "vectorSearchConfiguration": {
                        "numberOfResults": 5
                    }
                }
            },
            "type": "YOUR_TYPE"
        },
        "sessionId": "YOUR_SESSION_ID"
      }'

I haven't attempted this yet, but it could help determine whether the issue is isolated to the AWS console or if it's related to the API model anthropic.claude-3-sonnet-20240229-v1:0.

profile picture
エキスパート
回答済み 1ヶ月前
1

This was also happening with other models, however, appears to have resolved on its own now.

Julien
回答済み 1ヶ月前
1

Doesn't this happen even now?

回答済み 1ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ