Bedrock: Claude Model Selection (Context Window)

0

How can I determine which modelID is used when using on-demand Amazon Bedrock? For example, Claude 2.1 has 18k and 200k context window model IDs. Can I just provide the context window and count on the system to choose the cheapest model?

Thanks

1 回答
0
已接受的回答

Amazon Bedrock model IDs shows the model IDs. Below is a copy of the Anthropic models as of this answer. There is only one Claude 2.1 available (anthropic.claude-v2:1). From https://aws.amazon.com/bedrock/claude/ we see this is the one "with a 200K token context window".

ProviderModel nameVersionModel ID
AnthropicClaude2.0anthropic.claude-v2
AnthropicClaude2.1anthropic.claude-v2:1
AnthropicClaude 3 Sonnet1.0anthropic.claude-3-sonnet-20240229-v1:0
AnthropicClaude 3 Haiku1.0anthropic.claude-3-haiku-20240307-v1:0
AnthropicClaude Instant1.xanthropic.claude-instant-v1

The Anthropic Claude Text Completions API provides inference parameters, including max_tokens_to_sample (maximum number of tokens to generate before stopping). There is no parameter for input tokens / context window, since you control that via the prompt parameter.

profile pictureAWS
已回答 2 个月前
profile picture
专家
已审核 2 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则