Bedrock access problem
I am currently using Amazon Bedrock, but I am encountering a ThrottlingException: “Too many tokens per day” error. The issue occurs even on my first request of the day, and I am unable to generate any responses. All Providers and all model see same result even i cannot get any response since first setup.
Thank you for your assistance.
- Newest
- Most votes
- Most comments
Hello.
Your AWS account may have lower than default quotas as described in the documentation below.
I would recommend contacting AWS support to have this checked.
https://repost.aws/knowledge-center/bedrock-throttling-error
Request a quota increase
New AWS accounts might have lower initial quotas than the default quotas. Some models have non-adjustable fixed quotas. If your workload traffic exceeds your account's on-demand quotas, then contact AWS Support or your account manager to request a quota increase. AWS might adjust default quotas based on usage patterns or service requirements.
Include the following information in your request:
- The name of the quota that you want to increase
- The model ID
- The Region for the quota increase
- A brief explanation of your use case
- Your projected usage, including steady and peak tokens and requests per minute, and average input and output tokens per request
"Account and billing" inquiries are free of charge.
https://console.aws.amazon.com/support
Relevant content
- AWS OFFICIALUpdated 19 days ago
