Delete S3 bucket data after 30 days

0

Hello everyone, I'm still fairly new to AWS and am just getting used to it. I back up data via Veeam to an S3 bucket every day. This works quite well, but the memory becomes more and more full and the costs rise. In Veeam I have set the backups to be kept for a maximum of 14 days, but this doesn't seem to work for the S3 bucket. I tried setting up a deletion routine but it doesn't seem to work. I would be happy if someone here would support me with a how-to-do on how I can reduce the amount of data, as I won't be able to get any information with the help. Thanks in advance for your support

LG Chris

posta 4 mesi fa936 visualizzazioni
5 Risposte
2

Hello.

Veeam doesn’t support S3 Lifecycle policies on any S3 buckets that are used as Veeam object storage repositories. These include polices with Amazon S3 storage class transitions and S3 Lifecycle expiration rules. Veeam must be the sole entity that manages these objects. Enabling S3 Lifecycle policies might have unexpected results, including data loss. [Reference] https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/back-up-and-archive-data-to-amazon-s3-with-veeam-backup-replication.html

You should be able to configure the backup retention for from Veeam Console only, you can also have a look at the S3 bucket as Veeam should create folders within S3 Bucket for each day, so you can identify the number of backup copies kept in S3 Bucket.

you can also refer to below link to have more information on capacity tier and data retention:

https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_move.html & https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_retention.html

Hope this helps.

AWS
con risposta 4 mesi fa
0

Hello.

I think it is better to use lifecycle rules to delete data in S3.
By using this setting, it is possible to save objects for a specified number of days after they are uploaded to S3 and then delete them.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

In your case, you want to save for 14 days, so if you check "Expire current versions of objects" in the lifecycle rule and set the number of days to 14, it will be deleted after 14 days.
If you have versioning configured in S3, you will also need to create a lifecycle rule to delete old versions.

profile picture
ESPERTO
con risposta 4 mesi fa
profile picture
ESPERTO
verificato 4 mesi fa
profile picture
ESPERTO
verificato 4 mesi fa
0

|Hello Riku, thank you for your quick answer. I have set up a life cycle in the top folder under Administration. I have activated the following as lifecycle rules. "Permanently delete current object versions of objects" and "Delete non-current versions of objects" Under Expire current object versions I entered 14. I also entered 14 days under Permanently delete non-current versions of objects.

I hope I did everything right and it works.

Thanks for the support

con risposta 4 mesi fa
0
profile picture
ESPERTO
con risposta 4 mesi fa
0

As @Sheelnidhi mentioned, do NOT turn on lifecycle policies with Veeam. Keep in mind that your oldest objects will be older than the 14 days you've specified as your retention period. This is because Veeam retains objects if they are still referred to in an existing backup. However, your consumption will eventually "flatten" with Veeam, as it deletes objects from old backups.

profile pictureAWS
ESPERTO
wjquigs
con risposta 3 mesi fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande