Unanswered Questions tagged with S3 Transfer Acceleration
Content language: English
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Can you combine S3 Transfer Acceleration with Horizontal Scaling & Request Parallelization?
Can you combine [S3 Transfer Acceleration](https://docs.aws.amazon.com/whitepapers/latest/s3-optimizing-performance-best-practices/using-amazon-s3-transfer-acceleration-to-accelerate-geographically-disparate-data-transfers.html) with [Horizontal Scaling & Request Parallelization](https://docs.aws.amazon.com/whitepapers/latest/s3-optimizing-performance-best-practices/horizontal-scaling-and-request-parallelization-for-high-throughput.html)? I assume you'd just need to enable Transfer Acceleration on the destination bucket and then use the Acceleration endpoint when setting up a parallelization mechanism like [TransferManager](https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/examples-s3-transfermanager.html)?
How to properly and completely terminate a multipart upload?
In our Java app we have what is basically boilerplate S3 V2 code for creating a multipart upload of a file to S3. We absolutely need the ability to cancel the upload, and recover all resources used by the upload process, INCLUDING the CPU and network bandwidth. Initially we tried simply cancelling the completionFuture on the FileUpload, but that doesn't work. I can watch the network traffic continue to send data to S3, until the entire file is uploaded. Cancelling the completionFuture seems to stop S3 from reconstructing the file, but that's not sufficient. In most cases we need to cancel the upload because we need the network bandwidth for other things, like streaming video. I found the function shutdownNow() in the TransferManager class, and that seemed promising, but it looks like it's not available in the V2 SDK (I found it in the V1 sources). I've seen a function getSubTransfers() in the V1 MultipleFileUpload class that returns a list of Uploads, and the Upload class has an abort() function, but again, we need to use V2 for other reasons. I've also found and implemented code that calls listMultipartUploads, looks for the upload we want to cancel, creates an abortMultipartUploadRequest, issues it and the threads keep on rolling, and rolling, and rolling.... Is there a "correct" way of terminating a multipart upload, including the threads processing the upload?
How can i upload 50 MB file to s3 from edge device in multiple of 1 MB chunked size?
Hi, I want to upload 50 MB file to AWS S3 from embedded device. I want to chunk file in multiple of 1 MB and send 50 such PUT request for same object. (Providing range in HTTP header) Let me know the HTTP header field i have to set for this. Is there any example available in C language for same? Currently i could send PUT request to S3 and upload 1 MB data. But on subsequent request data is overwriting in same file instead of appending it. Let me know if you want more information. Thanks in advance, Darshak