Delete S3 bucket data after 30 days

0

Hello everyone, I'm still fairly new to AWS and am just getting used to it. I back up data via Veeam to an S3 bucket every day. This works quite well, but the memory becomes more and more full and the costs rise. In Veeam I have set the backups to be kept for a maximum of 14 days, but this doesn't seem to work for the S3 bucket. I tried setting up a deletion routine but it doesn't seem to work. I would be happy if someone here would support me with a how-to-do on how I can reduce the amount of data, as I won't be able to get any information with the help. Thanks in advance for your support

LG Chris

已提問 4 個月前檢視次數 936 次
5 個答案
2

Hello.

Veeam doesn’t support S3 Lifecycle policies on any S3 buckets that are used as Veeam object storage repositories. These include polices with Amazon S3 storage class transitions and S3 Lifecycle expiration rules. Veeam must be the sole entity that manages these objects. Enabling S3 Lifecycle policies might have unexpected results, including data loss. [Reference] https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/back-up-and-archive-data-to-amazon-s3-with-veeam-backup-replication.html

You should be able to configure the backup retention for from Veeam Console only, you can also have a look at the S3 bucket as Veeam should create folders within S3 Bucket for each day, so you can identify the number of backup copies kept in S3 Bucket.

you can also refer to below link to have more information on capacity tier and data retention:

https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_move.html & https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_retention.html

Hope this helps.

AWS
已回答 4 個月前
0

Hello.

I think it is better to use lifecycle rules to delete data in S3.
By using this setting, it is possible to save objects for a specified number of days after they are uploaded to S3 and then delete them.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

In your case, you want to save for 14 days, so if you check "Expire current versions of objects" in the lifecycle rule and set the number of days to 14, it will be deleted after 14 days.
If you have versioning configured in S3, you will also need to create a lifecycle rule to delete old versions.

profile picture
專家
已回答 4 個月前
profile picture
專家
已審閱 4 個月前
profile picture
專家
已審閱 4 個月前
0

|Hello Riku, thank you for your quick answer. I have set up a life cycle in the top folder under Administration. I have activated the following as lifecycle rules. "Permanently delete current object versions of objects" and "Delete non-current versions of objects" Under Expire current object versions I entered 14. I also entered 14 days under Permanently delete non-current versions of objects.

I hope I did everything right and it works.

Thanks for the support

已回答 4 個月前
0
profile picture
專家
已回答 4 個月前
0

As @Sheelnidhi mentioned, do NOT turn on lifecycle policies with Veeam. Keep in mind that your oldest objects will be older than the 14 days you've specified as your retention period. This is because Veeam retains objects if they are still referred to in an existing backup. However, your consumption will eventually "flatten" with Veeam, as it deletes objects from old backups.

profile pictureAWS
專家
wjquigs
已回答 3 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南