Skip to content

Anthropic LLM are not listed in Custom Model - Bedrock

0

Hi Team I wanted to "Create Fine Tune Model" from Bedrock (Custom Model Option). However, I cannot see the Anthropic LLM listed even though all Anthropic LLM is enabled in my account. I can see "Amazon" and "Cohere" in the selection list.

Please advise how to enable the Anthropic LLM so that I can fine-tune Anthropic

I am trying to follow this blog.

https://aws.amazon.com/blogs/machine-learning/fine-tune-anthropics-claude-3-haiku-in-amazon-bedrock-to-boost-model-accuracy-and-quality/

Thanks

2 Answers
1

Hello.

Which region are you using?
I confirmed that I can select Anthropic LLM when creating a fine tuning job in the Oregon region in my AWS account.
If you are not in the Oregon region, Anthropic LLM may not be available for fine tuning.
https://aws.amazon.com/jp/blogs/aws/fine-tuning-for-anthropics-claude-3-haiku-model-in-amazon-bedrock-is-now-generally-available/
a

EXPERT

answered 2 years ago

EXPERT

reviewed 2 years ago

  • Hello Riku Thanks for pointing it out. I was using US-East-1. I can see the Anthropic model in the Oregon region.

-3
Accepted Answer

I apologize, but there seems to be a misunderstanding in your question. Currently, Amazon Bedrock does not support fine-tuning or custom model creation for Anthropic's models, including Claude. The fine-tuning capabilities in Amazon Bedrock are limited to specific models, which is why you're only seeing options for Amazon and Cohere models in the Custom Model section.

The blog post you're referring to about fine-tuning Claude 3 Haiku is likely discussing a feature that is not yet generally available or may be part of a limited preview. As of now, the standard Bedrock service does not offer fine-tuning for Anthropic models.

To use Anthropic models in Amazon Bedrock, you can access them through the Model Access section of the Bedrock console. This allows you to use the pre-trained Anthropic models as they are, without fine-tuning. If you haven't already done so, you'll need to request access to these models by submitting use case details through the console.

For custom model creation and fine-tuning, you're currently limited to the models that are explicitly supported for this feature in Bedrock. If you need to work with customized language models, you might want to explore other AWS services or wait for potential future updates to Bedrock's capabilities regarding Anthropic models.
Sources
Community | AWS Bedrock - Learning Series - Blog 1
Access Anthropic models on Amazon Bedrock | AWS re:Post

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.