Bucket Size Discrepancy

0

Hello, My S3 bill has been creeping up to the point where I thought I should take a look. I am getting charged for almost 1.5tb of S3 storage, but I only use the bucket for webserver backups that are about 28gb.

When I go into the bucket, it says the bucket Size is 1.4tb, but when I calculate the folder size (there is only 1 folder in the bucket) it says it is 28gb. 28gb also matches what my webserver says is stored in S3.

Why is there such a large difference between what I am being billed for, and what is in the bucket?

Zerda
asked a year ago281 views
3 Answers
1
Accepted Answer

Please check to see if Versioning is enabled in the bucket.

Using versioning in S3 buckets - Amazon Simple Storage Service

Normal Amazon S3 rates apply for every version of an object stored and transferred. Each version of an object is the entire object; it is not just a diff from the previous version. Thus, if you have three versions of an object stored, you are charged for three objects.

profile picture
answered a year ago
0

It was indeed enabled. I don't know how it got enabled on that bucket. Thank you for your help, I forgot versioning was even something offered.

Zerda
answered a year ago
  • Just to add some other ideas to this thread. If you have versioning enabled, you can configure a Lifecycle Policy to remove older versions either by date or to keep only the last x (some number) of versions. [1]

    There is another answer on this post that talks about Multipart Uploads (MPUs). That is another source of common extra storage costs and can be removed also by Lifecycle Policies.

    I also highly recommend enabling S3 Storage Lens [2]. The default settings are free (advanced metrics have a cost). This can help you find old versions and MPUs in your buckets.

    [1] https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lifecycle-mgmt.html [2] https://aws.amazon.com/blogs/aws/s3-storage-lens/

0

if you use multipart uploads, you may have failed uploads stored in your bucket. Those aren't shown in the bucket, but need to be seen another way. You can set a lifecycle rule on your bucket to delete these failed uploads. Here's an article on how to do that. I would set it to one day at first or you'll have to wait quite a while for it to take effect. You can always change it later after it takes effect.

https://aws.amazon.com/blogs/aws-cloud-financial-management/discovering-and-deleting-incomplete-multipart-uploads-to-lower-amazon-s3-costs/

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions