By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Bedrock: 1 model unit = how many tokens/min throughput?

4

No where in the docs does it actually say what 1 model unit = how many tokens/min throughput. I'm sure this is different per model. There are on-demand pricing examples but the only provisioned example has model units with no token information.

Bedrock: 1 model unit = how many tokens/min throughput?

Topics
Machine Learning & AIGenerative AI on AWS
Tags
Amazon Bedrock
Language
English
dres
asked 7 months ago881 views
2 Answers
0

See: https://docs.aws.amazon.com/bedrock/latest/userguide/quotas.html#quotas-runtime It highlights "Tokens processed per minute" for each model. And yes, its different for different models.

rkt
answered a month ago
-3

Open a ticket to get these details from support.

AWS
EXPERT
Francis Flannery
answered 7 months ago
  • dres
    7 months ago

    I did. They couldn’t. This isn’t an answer nor is it helpful

  • mapledoum
    2 months ago

    if don't know the answer don't answer please

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content