Bedrock: Claude Model Selection (Context Window)

0

How can I determine which modelID is used when using on-demand Amazon Bedrock? For example, Claude 2.1 has 18k and 200k context window model IDs. Can I just provide the context window and count on the system to choose the cheapest model?

Thanks

preguntada hace 8 meses1,2 mil visualizaciones
1 Respuesta
1
Respuesta aceptada

Amazon Bedrock model IDs shows the model IDs. Below is a copy of the Anthropic models as of this answer. There is only one Claude 2.1 available (anthropic.claude-v2:1). From https://aws.amazon.com/bedrock/claude/ we see this is the one "with a 200K token context window".

ProviderModel nameVersionModel ID
AnthropicClaude2.0anthropic.claude-v2
AnthropicClaude2.1anthropic.claude-v2:1
AnthropicClaude 3 Sonnet1.0anthropic.claude-3-sonnet-20240229-v1:0
AnthropicClaude 3 Haiku1.0anthropic.claude-3-haiku-20240307-v1:0
AnthropicClaude Instant1.xanthropic.claude-instant-v1

The Anthropic Claude Text Completions API provides inference parameters, including max_tokens_to_sample (maximum number of tokens to generate before stopping). There is no parameter for input tokens / context window, since you control that via the prompt parameter.

profile pictureAWS
respondido hace 7 meses
profile picture
EXPERTO
revisado hace 5 meses
profile picture
EXPERTO
revisado hace 7 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas