AWS Builder Center is the official home for builders on AWS. Share and read what others are working on, follow people who inspire you, explore training and workshops, and find tools to support what you're building.
Can not increate invokeModel request to Claude 3.5 Sonnet v2
I can not increase quatas in Amazon Bedrock for model Claude 3.5 Sonnet v2. The checkbox labels are not available. And there is a value 'not adjustable'
I need limit as on image bottom
What i need to able to change these quotas? And how to chat AWS Support directly to increase these quatas, i need more throughput performance, cause we developing ai chat assistants?
- Newest
- Most votes
- Most comments
The situation you're describing is common for Amazon Bedrock quotas, especially for models like Claude 3.5 Sonnet v2. The "not adjustable" label and unavailable checkboxes indicate that these quotas cannot be increased through the standard Service Quotas console process.
To increase your quotas for on-demand InvokeModel requests and other Bedrock API-related limits, you'll need to follow a different approach:
-
Contact AWS Support directly. You can do this by visiting the AWS Support Center at https://support.console.aws.amazon.com/support/home#/
-
When creating a support case, select the appropriate category related to Amazon Bedrock or quota increases.
-
In your support request, be sure to include:
- The specific quota you want to increase (On-demand InvokeModel requests per minute)
- The model ID (Anthropic Claude 3.5 Sonnet v2)
- The AWS Region where you need the increase
- A clear explanation of your use case, detailing why you need higher quotas for developing AI chat assistants
-
Explain your current usage and the performance issues you're facing due to the current limits.
-
Specify the desired quota increase you're requesting.
AWS will review your request carefully. Approval is not guaranteed and may take some time, as they need to ensure proper resource allocation. While waiting for a response, you might consider using a multi-account strategy as a temporary solution, since token limits are account-level.
For high-throughput requirements, you could also explore Provisioned Throughput options, though this comes with additional costs and may not be suitable for all use cases.
Remember, AWS typically looks for accounts to be utilizing a high percentage (often 80-90%) of their current quota before approving significant increases, so be prepared to justify your need for the increased capacity.
Sources
How to increase AWS Bedrock quota for the specific model? | AWS re:Post
Request to Increase Low Service Quotas for On-Demand InvokeModel Requests and Bedrock API on New Root Account | AWS re:Post
Hello.
Please contact AWS Support from the URL below.
https://support.console.aws.amazon.com/support/home#/
When making an inquiry, I think there will be no problem if you select the items below.
Relevant content
asked a year ago
- AWS OFFICIALUpdated a year ago
