Models supported by the Bedrock RetrieveAndGenerate API?

0

In following the instructions to create a RAG-backed search experience I get the error below if I don't use a Claude model. Is Claude the only model supported by the RetrieveAndGenerate API?

So, this works:

    const command = new RetrieveAndGenerateCommand({
        input: {
            text: input
        },
        retrieveAndGenerateConfiguration: {
            type: 'KNOWLEDGE_BASE',
            knowledgeBaseConfiguration: {
                knowledgeBaseId: kbId,
                  modelArn: 'arn:aws:bedrock:us-east-1::foundation-model/anthropic.claude-v2'
              }
        }
    });

But this..

    const command = new RetrieveAndGenerateCommand({
        input: {
            text: input
        },
        retrieveAndGenerateConfiguration: {
            type: 'KNOWLEDGE_BASE',
            knowledgeBaseConfiguration: {
                knowledgeBaseId: kbId,
                   modelArn: 'arn:aws:bedrock:us-east-1::foundation-model/meta.llama2-70b-chat-v1'
              }
        }
    });

...throws the following error:

 model arn provided is not supported. Please check your configuration and retry the request.

I have access to both models.

Expected?

If so, are there plans to support other LLMs in this API?

Omi
質問済み 6ヶ月前1194ビュー
2回答
0

Currently Claude V1 and V2 are only supported for Knowledgebase. Other models are on the roadmap but they will need to support Chain of Thought using reasoning techniques like ReAct which not all models support. The following blog post provides some more background detail. Agents for Amazon Bedrock announcement

AWS
エキスパート
回答済み 5ヶ月前
0

The Amazon Bedrock User Guide Supported regions and models page contains the most recent information. As of 6-MAR-2023

You can use the following models to generate responses after retrieving information from knowledge bases:

  • Anthropic Claude Instant v1
  • Anthropic Claude v2.0
  • Anthropic Claude v2.1
profile pictureAWS
回答済み 3ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ