Delete S3 bucket data after 30 days

0

Hello everyone, I'm still fairly new to AWS and am just getting used to it. I back up data via Veeam to an S3 bucket every day. This works quite well, but the memory becomes more and more full and the costs rise. In Veeam I have set the backups to be kept for a maximum of 14 days, but this doesn't seem to work for the S3 bucket. I tried setting up a deletion routine but it doesn't seem to work. I would be happy if someone here would support me with a how-to-do on how I can reduce the amount of data, as I won't be able to get any information with the help. Thanks in advance for your support

LG Chris

feita há 4 meses935 visualizações
5 Respostas
2

Hello.

Veeam doesn’t support S3 Lifecycle policies on any S3 buckets that are used as Veeam object storage repositories. These include polices with Amazon S3 storage class transitions and S3 Lifecycle expiration rules. Veeam must be the sole entity that manages these objects. Enabling S3 Lifecycle policies might have unexpected results, including data loss. [Reference] https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/back-up-and-archive-data-to-amazon-s3-with-veeam-backup-replication.html

You should be able to configure the backup retention for from Veeam Console only, you can also have a look at the S3 bucket as Veeam should create folders within S3 Bucket for each day, so you can identify the number of backup copies kept in S3 Bucket.

you can also refer to below link to have more information on capacity tier and data retention:

https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_move.html & https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_retention.html

Hope this helps.

AWS
respondido há 4 meses
0

Hello.

I think it is better to use lifecycle rules to delete data in S3.
By using this setting, it is possible to save objects for a specified number of days after they are uploaded to S3 and then delete them.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

In your case, you want to save for 14 days, so if you check "Expire current versions of objects" in the lifecycle rule and set the number of days to 14, it will be deleted after 14 days.
If you have versioning configured in S3, you will also need to create a lifecycle rule to delete old versions.

profile picture
ESPECIALISTA
respondido há 4 meses
profile picture
ESPECIALISTA
avaliado há 4 meses
profile picture
ESPECIALISTA
avaliado há 4 meses
0

|Hello Riku, thank you for your quick answer. I have set up a life cycle in the top folder under Administration. I have activated the following as lifecycle rules. "Permanently delete current object versions of objects" and "Delete non-current versions of objects" Under Expire current object versions I entered 14. I also entered 14 days under Permanently delete non-current versions of objects.

I hope I did everything right and it works.

Thanks for the support

respondido há 4 meses
0
profile picture
ESPECIALISTA
respondido há 4 meses
0

As @Sheelnidhi mentioned, do NOT turn on lifecycle policies with Veeam. Keep in mind that your oldest objects will be older than the 14 days you've specified as your retention period. This is because Veeam retains objects if they are still referred to in an existing backup. However, your consumption will eventually "flatten" with Veeam, as it deletes objects from old backups.

profile pictureAWS
ESPECIALISTA
wjquigs
respondido há 3 meses

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas