Flow Bedrock: Error Knowledge Bases

The error you're encountering is related to how you're trying to invoke the Claude 3 Sonnet model in Amazon Bedrock. This model doesn't support on-demand throughput invocations directly. To resolve this issue, you need to use an inference profile.

Here's what you should do:

1. Go to the Amazon Bedrock console.
2. Navigate to the "Inference profiles" section.
3. Create a new inference profile or select an existing one that includes the Claude 3 Sonnet model.
4. Make sure the inference profile is properly configured with the settings you need.
5. In your Flow Bedrock setup, instead of using the model ID directly, use the ID or ARN (Amazon Resource Name) of the inference profile you created or selected.

Using an inference profile allows you to manage the throughput and other invocation settings for the Claude 3 Sonnet model more effectively. This approach is required for certain models in Bedrock that don't support direct on-demand invocations.

If you continue to face issues after setting up and using an inference profile, double-check your AWS credentials, region settings, and ensure that your IAM permissions include the necessary actions to invoke models and use inference profiles in Amazon Bedrock.

Also, make sure that you have enabled model access for the Claude 3 Sonnet model in the region where you're working. You can check and modify model access in the Bedrock console under the model access settings.
Sources
Bedrock API invocation error - on demand throughput isn's supported | AWS re:Post
Bedrock: When testing knowledge base can't select model to generate responses | AWS re:Post

You will need to use cross-region inference profile. Please check here AWS documentation how to achieve that: https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference.html

To call the US Anthropic Claude 3.7 Sonnet inference profile: https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-support.html#inference-profiles-support-system