Bedrock: Claude Model Selection (Context Window)

0

How can I determine which modelID is used when using on-demand Amazon Bedrock? For example, Claude 2.1 has 18k and 200k context window model IDs. Can I just provide the context window and count on the system to choose the cheapest model?

Thanks

1개 답변
0
수락된 답변

Amazon Bedrock model IDs shows the model IDs. Below is a copy of the Anthropic models as of this answer. There is only one Claude 2.1 available (anthropic.claude-v2:1). From https://aws.amazon.com/bedrock/claude/ we see this is the one "with a 200K token context window".

ProviderModel nameVersionModel ID
AnthropicClaude2.0anthropic.claude-v2
AnthropicClaude2.1anthropic.claude-v2:1
AnthropicClaude 3 Sonnet1.0anthropic.claude-3-sonnet-20240229-v1:0
AnthropicClaude 3 Haiku1.0anthropic.claude-3-haiku-20240307-v1:0
AnthropicClaude Instant1.xanthropic.claude-instant-v1

The Anthropic Claude Text Completions API provides inference parameters, including max_tokens_to_sample (maximum number of tokens to generate before stopping). There is no parameter for input tokens / context window, since you control that via the prompt parameter.

profile pictureAWS
답변함 2달 전
profile picture
전문가
검토됨 2달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠