- Newest
- Most votes
- Most comments
It appears that the Meta Llama 3.2 11B model (meta.llama3-2-11b-instruct-v1:0) is not currently supported for on-demand throughput in Amazon Bedrock as you expected. The error message suggests that this particular model requires the use of an inference profile rather than on-demand invocation.
To use this model, you would need to create an inference profile that includes the Meta Llama 3.2 11B model and then use the ID or ARN of that profile in your API call instead of directly specifying the model ID.
It's worth noting that model availability and supported invocation methods can vary. While some Llama models are available for on-demand use, this specific 11B version seems to have different requirements.
If you need to use this exact model, you'll need to set up an inference profile through the AWS Bedrock console or API. Alternatively, you could check if other versions of Llama 3.2 are available for on-demand use in your region, such as the 90B version which has been reported to work with on-demand invocation in some cases.
Always refer to the latest AWS documentation or contact AWS support for the most up-to-date information on model availability and invocation methods, as these can change over time.
Sources
How to get access of Meta3.2 Multi-modal models on bedrock. | AWS re:Post
Relevant content
asked 2 years ago
asked 3 years ago
