Skip to content

Do AWS Bedrock Application Inference Profile support ALL bedrock models ?

0

I'm trying to set up AIP for user usage observability on inference with frontier models, and this article mentions that:

[AIP] Works with all Bedrock models and supports cross-region inference

However, I cannot see all models in the console when trying to set up an AIP, eg. here on eu-west-1 where minimax should be available: minimax missing in AIP in eu-west-1

Whereas the "Model Catalog" clearly shows that minimax is available in eu-west-1: Minimax available in eu-west-1

So are AIPs limited in the number of available models ?

asked 24 days ago58 views
2 Answers
0

Yes, Application Inference Profiles (AIPs) can be created from all models and inference profiles supported in Amazon Bedrock. However, there's an important distinction to understand: AIPs can only be created in specific AWS Regions, not all regions where Bedrock is available.

Application inference profiles can be created for all models in the following AWS Regions: ap-northeast-1, ap-northeast-2, ap-south-1, ap-southeast-1, ap-southeast-2, ca-central-1, eu-central-1, eu-west-1, eu-west-2, eu-west-3, sa-east-1, us-east-1, us-east-2, us-gov-east-1, and us-west-2.

Since you're working in eu-west-1, which is in the supported list, and the article states that AIPs work with all Bedrock models, the issue you're experiencing with Minimax not appearing in the AIP console may be related to one of the following:

  1. The model may need to be explicitly enabled or have access requested in your account before it appears in the AIP creation interface
  2. There may be a timing issue where newly available models take time to appear in the AIP interface
  3. Certain models may have specific requirements or limitations that aren't immediately visible in the documentation

For tracking usage with frontier models like Minimax, AIPs should theoretically support them once they're properly enabled in your account. The benefits include automatic tag appearance in AWS Cost Explorer and Cost & Usage Reports, with no application logic changes beyond using the AIP ARN, and native integration with AWS cost management tools.

If the model continues not to appear, I'd recommend checking your model access settings and potentially reaching out to AWS Support for clarification on specific model availability within AIPs.
Sources
How to Track and Limit Amazon Bedrock Usage by User | AWS re:Post
Supported Regions and models for inference profiles - Amazon Bedrock

answered 24 days ago
0

The article you referenced is inaccurate on this point — Application Inference Profiles (AIPs) do not support all Bedrock models.

The key distinction:

AIPs support native Bedrock foundation models — Amazon Titan, Anthropic Claude, Meta Llama, Amazon Nova, Mistral (native), and similar. They do not support third-party Marketplace models.

Minimax is a Marketplace model. It appears in the Bedrock Model Catalog because AWS Marketplace models are surfaced there, but they are invoked through a different path (connector-based) and are not eligible for AIP creation.

This is why you see Minimax in the Model Catalog but not in the AIP creation console — this is expected behaviour, not a bug.

For observability on Marketplace model usage, the alternative is to use AWS CloudTrail to log bedrock:InvokeModel calls and filter by model ID, combined with cost allocation tags at the account or resource level.

How to check which models support AIPs programmatically:

aws bedrock list-foundation-models \
  --region eu-west-1 \
  --query 'modelSummaries[?inferenceTypesSupported[?contains(@,`ON_DEMAND`)]].modelId' \
  --output table

Only models returned here are eligible for AIP creation.

Ref: Supported models for inference profiles

answered 3 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.