Delete S3 bucket data after 30 days

0

Hello everyone, I'm still fairly new to AWS and am just getting used to it. I back up data via Veeam to an S3 bucket every day. This works quite well, but the memory becomes more and more full and the costs rise. In Veeam I have set the backups to be kept for a maximum of 14 days, but this doesn't seem to work for the S3 bucket. I tried setting up a deletion routine but it doesn't seem to work. I would be happy if someone here would support me with a how-to-do on how I can reduce the amount of data, as I won't be able to get any information with the help. Thanks in advance for your support

LG Chris

已提问 4 个月前934 查看次数
5 回答
2

Hello.

Veeam doesn’t support S3 Lifecycle policies on any S3 buckets that are used as Veeam object storage repositories. These include polices with Amazon S3 storage class transitions and S3 Lifecycle expiration rules. Veeam must be the sole entity that manages these objects. Enabling S3 Lifecycle policies might have unexpected results, including data loss. [Reference] https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/back-up-and-archive-data-to-amazon-s3-with-veeam-backup-replication.html

You should be able to configure the backup retention for from Veeam Console only, you can also have a look at the S3 bucket as Veeam should create folders within S3 Bucket for each day, so you can identify the number of backup copies kept in S3 Bucket.

you can also refer to below link to have more information on capacity tier and data retention:

https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_move.html & https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_retention.html

Hope this helps.

AWS
已回答 4 个月前
0

Hello.

I think it is better to use lifecycle rules to delete data in S3.
By using this setting, it is possible to save objects for a specified number of days after they are uploaded to S3 and then delete them.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

In your case, you want to save for 14 days, so if you check "Expire current versions of objects" in the lifecycle rule and set the number of days to 14, it will be deleted after 14 days.
If you have versioning configured in S3, you will also need to create a lifecycle rule to delete old versions.

profile picture
专家
已回答 4 个月前
profile picture
专家
已审核 4 个月前
profile picture
专家
已审核 4 个月前
0

|Hello Riku, thank you for your quick answer. I have set up a life cycle in the top folder under Administration. I have activated the following as lifecycle rules. "Permanently delete current object versions of objects" and "Delete non-current versions of objects" Under Expire current object versions I entered 14. I also entered 14 days under Permanently delete non-current versions of objects.

I hope I did everything right and it works.

Thanks for the support

已回答 4 个月前
0
profile picture
专家
已回答 4 个月前
0

As @Sheelnidhi mentioned, do NOT turn on lifecycle policies with Veeam. Keep in mind that your oldest objects will be older than the 14 days you've specified as your retention period. This is because Veeam retains objects if they are still referred to in an existing backup. However, your consumption will eventually "flatten" with Veeam, as it deletes objects from old backups.

profile pictureAWS
专家
wjquigs
已回答 3 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则