- Newest
- Most votes
- Most comments
Amazon Bedrock doesn't specifically publish a dedicated latency metric for knowledge bases in CloudWatch. However, you can monitor the performance of your Bedrock applications, including those using knowledge bases, through several approaches:
-
Use Amazon CloudWatch to monitor runtime metrics for your Bedrock invocations, which include InvocationLatency as one of the standard metrics.
-
For more detailed analysis, you can enable model invocation logging to S3 and then query this data using Amazon Athena. You can extract latency information with SQL queries like:
SELECT
timestamp,
operation,
modelid,
requestid,
output.outputbodyjson.metrics.latencyms as latencyms
FROM "bedrocklogsdb"."bedrocklogs"
-
You can visualize this latency data using Amazon QuickSight by creating line charts that show average latency over time.
-
For third-party monitoring solutions, tools like IBM Instana can collect metrics on model latency for Amazon Bedrock applications.
By analyzing these latency metrics, you can identify performance bottlenecks and optimize your knowledge base implementations.
Sources
Monitoring the performance of Amazon Bedrock - Amazon Bedrock
Monitor and optimize your Amazon Bedrock usage with Amazon Athena and Amazon QuickSight | AWS Business Intelligence Blog
Monitor Amazon Bedrock Guardrails using CloudWatch metrics - Amazon Bedrock
Monitoring Amazon Bedrock Large Language Models with IBM Instana | IBM & Red Hat on AWS
answered a year ago
Relevant content
asked 23 days ago
asked a year ago

but this one is not for KB. i want the one can tell the RetrieveAndGenerate latency metrics when calling the bedrock KB by using Lex