Bucket Size Discrepancy

0

Hello, My S3 bill has been creeping up to the point where I thought I should take a look. I am getting charged for almost 1.5tb of S3 storage, but I only use the bucket for webserver backups that are about 28gb.

When I go into the bucket, it says the bucket Size is 1.4tb, but when I calculate the folder size (there is only 1 folder in the bucket) it says it is 28gb. 28gb also matches what my webserver says is stored in S3.

Why is there such a large difference between what I am being billed for, and what is in the bucket?

Zerda
gefragt vor einem Jahr290 Aufrufe
3 Antworten
1
Akzeptierte Antwort

Please check to see if Versioning is enabled in the bucket.

Using versioning in S3 buckets - Amazon Simple Storage Service

Normal Amazon S3 rates apply for every version of an object stored and transferred. Each version of an object is the entire object; it is not just a diff from the previous version. Thus, if you have three versions of an object stored, you are charged for three objects.

profile picture
beantwortet vor einem Jahr
0

It was indeed enabled. I don't know how it got enabled on that bucket. Thank you for your help, I forgot versioning was even something offered.

Zerda
beantwortet vor einem Jahr
  • Just to add some other ideas to this thread. If you have versioning enabled, you can configure a Lifecycle Policy to remove older versions either by date or to keep only the last x (some number) of versions. [1]

    There is another answer on this post that talks about Multipart Uploads (MPUs). That is another source of common extra storage costs and can be removed also by Lifecycle Policies.

    I also highly recommend enabling S3 Storage Lens [2]. The default settings are free (advanced metrics have a cost). This can help you find old versions and MPUs in your buckets.

    [1] https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lifecycle-mgmt.html [2] https://aws.amazon.com/blogs/aws/s3-storage-lens/

0

if you use multipart uploads, you may have failed uploads stored in your bucket. Those aren't shown in the bucket, but need to be seen another way. You can set a lifecycle rule on your bucket to delete these failed uploads. Here's an article on how to do that. I would set it to one day at first or you'll have to wait quite a while for it to take effect. You can always change it later after it takes effect.

https://aws.amazon.com/blogs/aws-cloud-financial-management/discovering-and-deleting-incomplete-multipart-uploads-to-lower-amazon-s3-costs/

beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen