Bedrock: Claude Model Selection (Context Window)

Question

How can I determine which modelID is used when using on-demand Amazon Bedrock?
For example, Claude 2.1 has 18k and 200k context window model IDs. 
Can I just provide the context window and count on the system to choose the cheapest model?

Thanks

Accepted Answer

[Amazon Bedrock model IDs](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html) shows the model IDs.  Below is a copy of the Anthropic models as of this answer.  There is only one Claude 2.1 available (anthropic.claude-v2:1).  From https://aws.amazon.com/bedrock/claude/ we see this is the one "with a 200K token context window".

| Provider|Model name|Version|Model ID|
| --- | --- | --- | --- |
|Anthropic|Claude|2.0|anthropic.claude-v2|
|Anthropic|Claude|2.1|anthropic.claude-v2:1|
|Anthropic|Claude 3 Sonnet|1.0|anthropic.claude-3-sonnet-20240229-v1:0|
|Anthropic|Claude 3 Haiku|1.0|anthropic.claude-3-haiku-20240307-v1:0|
|Anthropic|Claude Instant|1.x|anthropic.claude-instant-v1|

The [Anthropic Claude Text Completions API](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-anthropic-claude-text-completion.html) provides inference parameters, including `max_tokens_to_sample` (maximum number of tokens to generate before stopping).  There is no parameter for input tokens / context window, since you control that via the `prompt` parameter.

Provider	Model name	Version	Model ID
Anthropic	Claude	2.0	anthropic.claude-v2
Anthropic	Claude	2.1	anthropic.claude-v2:1
Anthropic	Claude 3 Sonnet	1.0	anthropic.claude-3-sonnet-20240229-v1:0
Anthropic	Claude 3 Haiku	1.0	anthropic.claude-3-haiku-20240307-v1:0
Anthropic	Claude Instant	1.x	anthropic.claude-instant-v1

Bedrock: Claude Model Selection (Context Window)

Contenido relevante