AWS Bedrock - is there a "native" Model usage log? Without the need to have CloudWatch, S3 or other ...
Hi, I am migrating from Anthropic "direct" API do AWS Anthropic API.
On Antrophic we have a simple usage log with the time, model, model latency, input tokens, output tokens and type (API or console). I dont need the prompt and text input and output as we capture that on the application already. Example of the report below:
I am new to AWS and trying to find that. Is there something simple like this?
I see that for a more robust log I would need to install CloudWatch, S3 or other repository but I am trying to keep it simple.
Thanks in advance,
Leo
- 新しい順
- 投票が多い順
- コメントが多い順
Hi THere
There isnt a native dashboard, but you can turn on Bedrock Invocation Logs and log the data to CloudWatch Logs. You can then use a CloudWatch Logs query like:
fields @timestamp, input.inputTokenCount, output.outputTokenCount, modelId, operation
And then create a dashboard to get the data you are looking for.
You can also use CloudWatch Metrics to build a dashboard to see overall statistics over time like average invocation time, total token counts, etc.
You would have to use CloudWatch and S3 for logging.
Great detailed answer! Thanks!
Yes, that what I personally do: use the metrics generated in CloudWatch by Bedrock to create nice and efficient CloudWatch dashboards. So, it brings observability to Bedrock.