Does citation coverage use both citations or retreived refrences from KB lookup

Citation coverage evaluates how well a response's content is supported by its citations. It measures the ratio between the faithfulness of the response to the cited passages and the faithfulness to all retrieved passages.

A citation coverage score of 1 indicates that all information that could have been cited (based on the retrieved passages) was properly cited. This doesn't necessarily mean all information in the response is cited, but rather that all information from the retrieved passages that should have been cited was properly cited.

In your example with four citations, the citation coverage score of 1 suggests that each response part that used information from retrieved passages included proper citations. The response parts correspond to the citations rather than just the retrieved documents themselves. This means your system is effectively citing the sources it's using to generate responses.

It's worth noting that citation coverage should be used together with citation precision for a complete view of citation quality. While citation coverage is similar to citation recall (measuring how well responses are supported by citations), citation precision measures the number of correct citations in the response.

Sources
Evaluate models or RAG systems using Amazon Bedrock Evaluations – Now generally available | AWS Machine Learning Blog
Review metrics for RAG evaluations that use LLMs (console) - Amazon Bedrock
Mistral Large 1 (24.02) - Amazon Bedrock