AWS Bedrock - Claude Model invocations are raising Exception

0

Claude Model invocations are raising the following exception:

Aws::BedrockRuntime::Errors::ModelErrorException: The system encountered an unexpected error during processing. Try your request again.

This error only started today, and appears to be inconsistently being raised, regardless of input/input length.

  • The region is us-east-1.
  • Retry appears work sometimes, doesn't most of the time.
  • Model ID: anthropic.claude-3-haiku-20240307-v1:0
  • This also appears to be an issue while testing knowledge bases (RAG) along with model selection (Generate Responses option selected) within the AWS Console (Bedrock)

3개 답변
2

You can attempt to troubleshoot the issue by using the Amazon Bedrock API, construct a POST request to the endpoint https://runtime.bedrock.{region}.amazonaws.com/agent/{agentName}/runtime/retrieveAndGenerate, where {region} is your AWS region and {agentName} is the name of your Bedrock agent. The request body should follow the provided syntax, filling in the necessary fields such as knowledgeBaseId, modelArn, and text for the input prompt.

Something like this:

curl -X POST \
  https://runtime.bedrock.us-east-1.amazonaws.com/agent/{yourAgent}/runtime/retrieveAndGenerate \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer YOUR_ACCESS_TOKEN' \
  -d '{
        "input": {
            "text": "What is the capital of Dominican Republic?"
        },
        "retrieveAndGenerateConfiguration": {
            "knowledgeBaseConfiguration": {
                "generationConfiguration": {
                    "promptTemplate": {
                        "textPromptTemplate": "The answer is:"
                    }
                },
                "knowledgeBaseId": "YOUR_KNOWLEDGE_BASE_ID",
                "modelArn": "YOUR_MODEL_ARN",
                "retrievalConfiguration": {
                    "vectorSearchConfiguration": {
                        "numberOfResults": 5
                    }
                }
            },
            "type": "YOUR_TYPE"
        },
        "sessionId": "YOUR_SESSION_ID"
      }'

I haven't attempted this yet, but it could help determine whether the issue is isolated to the AWS console or if it's related to the API model anthropic.claude-3-sonnet-20240229-v1:0.

profile picture
전문가
답변함 한 달 전
1

This was also happening with other models, however, appears to have resolved on its own now.

Julien
답변함 한 달 전
1

Doesn't this happen even now?

답변함 한 달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠