S3 Object Lock and incomplete uploads.

0

Say you want to upload a bunch of really large files. However somewhere in between the upload something goes wrong. The files don't complete.

The whole thing is a mess so you just want to start over. If you set up the bucket with Object Lock in Compliance mode. You're pretty much just going to have to eat the costs for the durations of the retention period? Am I understanding this correctly?

Do you guys have any advice for dealing with these situations? This is for backups I am currently using Amazon S3 (not Glacier). Perhaps I should be using Amazon S3 Glacier with Vault lock instead. But I'm not as familiar with it as I've never used it before.

Is there a better way to handle this situation? Ultimately I want the files to be immutable after I upload them. But I wouldn't mind if it waited until the upload finished.

(SEPARATE QUESTION) Another problem I run into is my S3 Browser uploads everything as "Standard". When I change everything to Glacier Deep Storage it redownloads the data again. While also creating a separate version still in Standard. Am I going to be charged for both? And if so is there any way to avoid this besides using the funky browser upload? (That is how I got the messed up original upload)

So in summation:

  1. How does Object Lock handle incomplete uploads. Is there anyway to delete them after you uploaded them.
  2. Is there a better way to apply a different storage tier to an Object Locked S3 Bucket. Besides uploading it twice or using the browser.

Thank you!

질문됨 2년 전679회 조회
1개 답변
0

This doesn't answer your question, but it might save you some money. If you're doing multipart uploads to S3, you need to know to create a lifecycle rule that deletes failed multipart uploads from each bucket that you upload to. Here's a document on how to do that. I don't think you need to wait 7 days for it to take effect though. You might want to choose a shorter time frame. https://aws.amazon.com/blogs/aws-cloud-financial-management/discovering-and-deleting-incomplete-multipart-uploads-to-lower-amazon-s3-costs/

답변함 2년 전
  • If you do find you're being charged for multipart failed uploads, you can request a refund from AWS. Just open a case and tell them which buckets you were uploading to and how far back this uploading was being done and they will take care of it.

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠