Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

Anthropic Claude Usage Tiers Using Bedrock

0

We've been using Claude 3 Sonnet for months via Bedrock and switched to Claude 3.5 Sonnet and now we are experiencing rate limit HTTP 429 errors from the Bedrock API (too many requests) that we never experienced with Claude 3 (see Anthropic rate limits at https://docs.anthropic.com/en/api/rate-limits). How do we know what usage tier we are on Anthropic if we are a Bedrock user? And does you usage tier get reset when you change to a new model? Thanks

Topics
Machine Learning & AIGenerative AI on AWS
Tags
Machine Learning & AIAmazon Bedrock
Language
English
asked a year ago5K views
2 Answers
1

Seems like Anthropic quotas in Bedrock for Claude 3 Sonnet and Claude 3.5 Sonnet are drastically different (10X less for Claude 3.5 Sonnet - 50 requests per minute versus 500 requests per minute). And it seems you cannot request an increase. That's unfortunate.

https://us-east-1.console.aws.amazon.com/servicequotas/home/services/bedrock/quotas

answered a year ago
EXPERT
reviewed a year ago
EXPERT
reviewed a year ago
  • Didier Durand EXPERT
    a year ago

    Hi, agreed: we also experience lower quotas for Sonnet v3.5 when compared to v3. And you cannot upgrade for now.

0

Please work with your TAM or SA or AM to do an internal quota increase request. The quotas for the bedrock models have a different increase approval process internally. HTH

AWS
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content