Models supported by the Bedrock RetrieveAndGenerate API?

0

In following the instructions to create a RAG-backed search experience I get the error below if I don't use a Claude model. Is Claude the only model supported by the RetrieveAndGenerate API?

So, this works:

    const command = new RetrieveAndGenerateCommand({
        input: {
            text: input
        },
        retrieveAndGenerateConfiguration: {
            type: 'KNOWLEDGE_BASE',
            knowledgeBaseConfiguration: {
                knowledgeBaseId: kbId,
                  modelArn: 'arn:aws:bedrock:us-east-1::foundation-model/anthropic.claude-v2'
              }
        }
    });

But this..

    const command = new RetrieveAndGenerateCommand({
        input: {
            text: input
        },
        retrieveAndGenerateConfiguration: {
            type: 'KNOWLEDGE_BASE',
            knowledgeBaseConfiguration: {
                knowledgeBaseId: kbId,
                   modelArn: 'arn:aws:bedrock:us-east-1::foundation-model/meta.llama2-70b-chat-v1'
              }
        }
    });

...throws the following error:

 model arn provided is not supported. Please check your configuration and retry the request.

I have access to both models.

Expected?

If so, are there plans to support other LLMs in this API?

2개 답변
0

Currently Claude V1 and V2 are only supported for Knowledgebase. Other models are on the roadmap but they will need to support Chain of Thought using reasoning techniques like ReAct which not all models support. The following blog post provides some more background detail. Agents for Amazon Bedrock announcement

AWS
전문가
답변함 5달 전
0

The Amazon Bedrock User Guide Supported regions and models page contains the most recent information. As of 6-MAR-2023

You can use the following models to generate responses after retrieving information from knowledge bases:

  • Anthropic Claude Instant v1
  • Anthropic Claude v2.0
  • Anthropic Claude v2.1
profile pictureAWS
답변함 3달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠