1 Answer
- Newest
- Most votes
- Most comments
1
When defining your data source you can choose the S3 bucket or a prefix within the bucket. Everything under what you choose will be indexed.
Hope this helps!
When defining your data source you can choose the S3 bucket or a prefix within the bucket. Everything under what you choose will be indexed.
Hope this helps!
Can you please elaborate prefix part? Currently i have S3 URI as s3://yk-test-foldered, which is a root folder, under which i have the required hierarchy. How URI should look with prefix? Thank you YK PS Also when i tried again everything worked as it supposed to...i still need to check number of indexes...
A prefix would be the same as a directory within the bucket. In S3 they are not really directories but just prefixes in the name of key (file). In the below, folder-1 and folder-2 would be prefixes.
s3://my-test-bucket s3://my-test-bucket/folder-1/file-1 s3://my-test-bucket/folder-1/file-2 s3://my-test-bucket/folder-2/file-1 s3://my-test-bucket/folder-2/file-2
so for s3://my-test-bucket everything in this folder and underlaying hierarchy should be indexed? that did not fork before but worked yesterday. i will do a clear source and try again. Thank you YK