AWS Bedrock - is there a "native" Model usage log? Without the need to have CloudWatch, S3 or other ...
Hi, I am migrating from Anthropic "direct" API do AWS Anthropic API.
On Antrophic we have a simple usage log with the time, model, model latency, input tokens, output tokens and type (API or console). I dont need the prompt and text input and output as we capture that on the application already. Example of the report below:
I am new to AWS and trying to find that. Is there something simple like this?
I see that for a more robust log I would need to install CloudWatch, S3 or other repository but I am trying to keep it simple.
Thanks in advance,
Leo
- Le plus récent
- Le plus de votes
- La plupart des commentaires
Hi THere
There isnt a native dashboard, but you can turn on Bedrock Invocation Logs and log the data to CloudWatch Logs. You can then use a CloudWatch Logs query like:
fields @timestamp, input.inputTokenCount, output.outputTokenCount, modelId, operation
And then create a dashboard to get the data you are looking for.
You can also use CloudWatch Metrics to build a dashboard to see overall statistics over time like average invocation time, total token counts, etc.
You would have to use CloudWatch and S3 for logging.
Contenus pertinents
- demandé il y a un an
- demandé il y a 2 mois
AWS OFFICIELA mis à jour il y a 3 ans- AWS OFFICIELA mis à jour il y a 7 mois
Great detailed answer! Thanks!
Yes, that what I personally do: use the metrics generated in CloudWatch by Bedrock to create nice and efficient CloudWatch dashboards. So, it brings observability to Bedrock.