Bedrock: Claude Model Selection (Context Window)

0

How can I determine which modelID is used when using on-demand Amazon Bedrock? For example, Claude 2.1 has 18k and 200k context window model IDs. Can I just provide the context window and count on the system to choose the cheapest model?

Thanks

已提問 2 個月前檢視次數 650 次
1 個回答
0
已接受的答案

Amazon Bedrock model IDs shows the model IDs. Below is a copy of the Anthropic models as of this answer. There is only one Claude 2.1 available (anthropic.claude-v2:1). From https://aws.amazon.com/bedrock/claude/ we see this is the one "with a 200K token context window".

ProviderModel nameVersionModel ID
AnthropicClaude2.0anthropic.claude-v2
AnthropicClaude2.1anthropic.claude-v2:1
AnthropicClaude 3 Sonnet1.0anthropic.claude-3-sonnet-20240229-v1:0
AnthropicClaude 3 Haiku1.0anthropic.claude-3-haiku-20240307-v1:0
AnthropicClaude Instant1.xanthropic.claude-instant-v1

The Anthropic Claude Text Completions API provides inference parameters, including max_tokens_to_sample (maximum number of tokens to generate before stopping). There is no parameter for input tokens / context window, since you control that via the prompt parameter.

profile pictureAWS
已回答 2 個月前
profile picture
專家
已審閱 2 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南