AWS Bedrock - is there a "native" Model usage log? Without the need to have CloudWatch, S3 or other ...
Hi, I am migrating from Anthropic "direct" API do AWS Anthropic API.
On Antrophic we have a simple usage log with the time, model, model latency, input tokens, output tokens and type (API or console). I dont need the prompt and text input and output as we capture that on the application already. Example of the report below:
I am new to AWS and trying to find that. Is there something simple like this?
I see that for a more robust log I would need to install CloudWatch, S3 or other repository but I am trying to keep it simple.
Thanks in advance,
Leo
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
Hi THere
There isnt a native dashboard, but you can turn on Bedrock Invocation Logs and log the data to CloudWatch Logs. You can then use a CloudWatch Logs query like:
fields @timestamp, input.inputTokenCount, output.outputTokenCount, modelId, operation
And then create a dashboard to get the data you are looking for.
You can also use CloudWatch Metrics to build a dashboard to see overall statistics over time like average invocation time, total token counts, etc.
You would have to use CloudWatch and S3 for logging.
Relevanter Inhalt
AWS OFFICIALAktualisiert vor 3 Jahren- AWS OFFICIALAktualisiert vor 3 Jahren
Great detailed answer! Thanks!
Yes, that what I personally do: use the metrics generated in CloudWatch by Bedrock to create nice and efficient CloudWatch dashboards. So, it brings observability to Bedrock.