- Newest
- Most votes
- Most comments
The best way to achieve this use case is to implement a secondary indexing database in DynamoDB for the prefix and object names that reside in your S3 bucket. S3 is not designed to be able to perform server-side filtering for LIST API calls. Additionally, LIST API calls can become very expensive over time on Amazon S3. DynamoDB would be a much more suitable for this use case as you would be able to query the data server-side and only returning the required results to the client.
The following AWS Blog post dicusses how you can build a secondary indexing database for Amazon S3 on DynamoDB: https://aws.amazon.com/blogs/big-data/building-and-maintaining-an-amazon-s3-metadata-index-without-servers/
Additionally, you can also use S3 Inventory Reports to get a list of objects in your Amazon S3 bucket, without having to setup a secondary indexing database on DynamoDB: https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-inventory.html
Relevant content
- asked 3 months ago
- asked a year ago
- asked a year ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago