Skip to content

Data sync in bedrock knowledge base

0

How does AWS Bedrock Knowledge Base syncing work internally? I have 10 files in S3, and after deleting and re-uploading them, the sync status does not show the files as modified. Can someone explain how the sync process handles file changes and updates?

1 Answer
1

Hello.

Bedrock's knowledge base works with the following actions.

[+] Sync your data with your Amazon Bedrock knowledge base

https://docs.aws.amazon.com/ko_kr/bedrock/latest/userguide/kb-data-source-sync-ingest.html

Each time you add, modify, or remove files from your data source, you must sync the data source so that it is re-indexed to the knowledge base. 
Syncing is incremental, so Amazon Bedrock only processes added, modified, or deleted documents since the last sync.

If you put it in the S3 folder connected to Bedrock, it will not be automatically synchronized, so please check the link below additionally.

[+] Does Knowledge Base auto update data from s3

https://repost.aws/questions/QUZOmMEo5hTLOZ4cZn9l7jrg/does-knowledge-base-auto-update-data-from-s3

AWS
SUPPORT ENGINEER
answered 2 years ago
EXPERT
reviewed 2 years ago
EXPERT
reviewed 2 years ago
  • I have a glue job running for the syncing process, so every day the files from s3 will be synced to kb, only issue is that if the file is deleted and reuploaded in the s3 and synced, that file is not showing as modified.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.