AWS Bedrock - Knowledge base testing

0

I have set up the knowledge base of my sample data in s3 with Bedrock and created the data source in the console. Now i tested the knowledge base by posting the query to Anthropic Claude and i don't get relevant answers to my data. Responses turn out as inaccurate. What can i do ? will appreciate your responses.

sree
asked 4 months ago997 views
2 Answers
0

Hello.

Have you synchronized the underlying data in your knowledge base?
https://docs.aws.amazon.com/bedrock/latest/userguide/knowledge-base-manage.html

profile picture
EXPERT
answered 4 months ago
  • Yes I synced the data in the knowledge base. But still getting incorrect response from FM for the queries in the Test knowledge base playground.

0

Hi,

You should initially implement a use case ensuring that your KB is properly used by Claude in its answer. In particular, you should leverage the source attribution features of Bedrock to have a clear proof that it used your data: see https://aws.amazon.com/bedrock/knowledge-bases/ for explanation of source attribution

Then, I would suggest that you replicate this demo in your environment to validate source attribution to your KB: https://community.aws/content/2ZALOArFoqNipOSZreZsXzRTny5/aws-bedrock---knowledge-base---demo?lang=en

Best,

Didier

profile pictureAWS
EXPERT
answered 4 months ago
profile picture
EXPERT
reviewed a month ago
  • Followed the documentation and configured the knowledge base, data source , synced vector store based on the doc. Then i tested the KB with the queries related to the data in KB. But getting incorrect responses from FM. All i guess is the foundation model is not trained on the KB / not in sync with data

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions