- Newest
- Most votes
- Most comments
You're on the right track with your understanding of S3 Glacier Deep Archive deletion policies. Here's what you need to know:
-
Minimum storage duration: Objects in Glacier Deep Archive have a minimum storage duration of 180 days. If you delete objects before this period, you'll incur early deletion fees.
-
Safe deletion: For objects that have been in Glacier Deep Archive for more than 180 days, you can delete them without incurring any additional charges beyond the normal S3 request fees.
-
Identifying safe-to-delete objects: If the objects are labeled with dates from 2022 or earlier, they have likely been in storage for more than 180 days, making them safe to delete without extra charges.
-
Using lifecycle rules: You are correct that you can set up a lifecycle rule to automatically delete objects that have been in Glacier Deep Archive for more than 180 days. This is an efficient way to manage your storage and avoid unnecessary costs.
-
Caution with bulk deletions: When dealing with a large number of objects (millions or billions), it's recommended to use lifecycle rules for deletion rather than manual processes. This helps avoid unexpected costs and ensures a more controlled deletion process.
-
Checking last access date: For objects in standard storage classes, you might want to consider their last access date before deletion. This can be done by enabling and analyzing S3 server access logs or CloudTrail data event logs.
-
Gradual approach: Given the previous incident of costly deletions, it might be wise to start with a small subset of objects or a single bucket to verify your deletion strategy before applying it widely.
Remember, while DELETE operations themselves are free, you need to be cautious about the storage duration of the objects you're deleting. Always double-check your lifecycle rules and deletion criteria before implementing them across multiple buckets.
Sources
Delete Billions of objects from S3 Bucket | AWS re:Post
Permanently delete from Glacier Deep Archive | AWS re:Post
Delete unused files from S3 | AWS re:Post
S3 Early deletion Fees | AWS re:Post
Hello.
If you configure the following settings, you will have a rule that deletes objects 180 days after they are moved to Glacier.
As you are aware, deleting an object from Glacier before 180 days have passed since it was moved there incurs a charge.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-transition-general-considerations.html
Number of days you plan to keep objects archived – S3 Glacier Flexible Retrieval and S3 Glacier Deep Archive are long-term archival solutions. The minimal storage duration period is 90 days for the S3 Glacier Flexible Retrieval storage class and 180 days for S3 Glacier Deep Archive. Deleting data that is archived to Amazon S3 Glacier doesn't incur charges if the objects you delete are archived for more than the minimal storage duration period. If you delete or overwrite an archived object within the minimal duration period, Amazon S3 charges a prorated early deletion fee. For information about the early deletion fee, see the "How am I charged for deleting objects from Amazon S3 Glacier that are less than 90 days old?" question on the Amazon S3 FAQ.
Relevant content
asked 3 years ago
asked 2 years ago
