Exporting DynamoDB table to S3

Question

I am trying to figure out the number of objects that gets created inside the S3 bucket when we make use of DynamoDB Export to S3 feature. We have a table whose size is around ~500TB that we want to export to S3.

I couldn't figure out how many objects would get created and what would be the size of each object when we do an export.

Answer

Its difficult to estimate how many files will be created. Usually its close to 1 file per partition, and we know that each partition is capable of holding ~ 10GB ~ of data. Meaning you can expect approximately 50k objects for your export of 500TB:

500TB / 10GB = 50,000

`500TB / 10GB = 50,000`

Exporting DynamoDB table to S3

Relevanter Inhalt