bedrock chat playground ThrottlingException

Question

newer to bedrock. i am trying to use the chat playground but no matter what model I select it tells me
ThrottlingException - Too many tokens per day, please wait before trying again.

i haven't used much of anything and when i check cloud metrics i should be well within the limits

any idea what i can do or I can check would be appreciated

Riku_Kobayashi · Answer

Hello.

Perhaps your AWS account has a low quota for "On-demand InvokeModel".  
https://docs.aws.amazon.com/general/latest/gr/bedrock.html#limits_bedrock

I recommend that you request an increase in the "On-demand InvokeModel" for the model you want to use through Service Quotas or by opening a case with AWS Support under "Account and billing".  
Please select a category below to inquire.  
https://support.console.aws.amazon.com/support/home#/case/create  
![a](/media/postImages/original/IMGVmV2jPcSmyeFHAujmVEow)

re:Post Agent · Answer

You're encountering a common issue with Amazon Bedrock where you're receiving a "ThrottlingException" error with the message "Too many tokens per day, please wait before trying again" despite minimal usage.

This appears to be an unusual problem that several Bedrock users have experienced recently and may not be directly related to your actual usage. In some cases, on-demand quotas for certain regions and models may have been inadvertently set incorrectly (sometimes even to 0), causing throttling errors even with minimal usage.

Here are some steps you can take to resolve this issue:

1. Try switching regions: Some users have reported success by switching from one region (like us-east-1) to another region (like us-west-2) where resources might be more available.

2. Consider using cross-region inference if available for your use case.

3. Open a support case with AWS: Even without a technical support plan, you can raise this through general or billing support. Describe the issue, mentioning that you're getting throttling errors despite minimal usage and quotas showing as greater than 0.

4. Check your current quotas: Review your Amazon Bedrock quotas in the AWS Management Console to confirm they are indeed set properly.

AWS Support should be able to investigate and correct the quotas for your account, though the process might take around 48 hours to resolve. This issue doesn't reflect the normal operation of Bedrock and should be temporary.  
**Sources**  
[Troubleshoot Amazon Bedrock on-demand resource 429 Throttling error  | AWS re:Post](https://repost.aws/knowledge-center/bedrock-throttling-error)  
[Unable to try out Bedrock | AWS re:Post](https://repost.aws/questions/QUHJBbArN5QOqc21xmVP9ZJg/unable-to-try-out-bedrock)  
[Bedrock Test Agent quota error | AWS re:Post](https://repost.aws/questions/QU2yXIGiFJSeGrrmaqrcsk8Q/bedrock-test-agent-quota-error)

bedrock chat playground ThrottlingException

Add your answer

Relevant content