Does transferring HTTP payload in multiple chunks to s3 count as multiple requests in term of pricing ?
I am considering using the mechanism described here to transfer data in chunks from a micro controller to AWS S3. If I need to cut my payload into 10 000 chunks (so that it fits in RAM) would that mean that i'll have to pay for 10 000 HTTP requests ?
Thanks for your help,
David.
This doc suggests you are billed for all storage, bandwidth, and requests for this multipart upload and its associated parts: https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html#mpuploadpricing.
So for your example, assuming S3 Standard Storage Tier: 10,000 POST Object requests would cost $0.05 (10000 * $0.005 / 1000) (Pricing from here). For S3, you don't pay per GB for data-in, so the requests and storage would be your only S3 charges for the upload.
Just shooting in the dark here, but you may be able to use another S3 authorization mechanism (like presigned URLs) to avoid having to compute a SigV4 signature (which is driving you to load chunks into RAM). This may allow you to stream the entire payload from disk in a single HTTP request.
Relevant questions
S3 file drop fire multiple Lambdas
Accepted Answerasked 4 years agoSync from S3 to local pricing comparison
asked 6 months agoMultiple Kinesis Firehose Destinations
Accepted Answerasked 2 years agoIs the pricing of using services in outpost the same as using on cloud?
Accepted Answerasked 6 months agoDoes Amazon CloudFront cache HTTP and HTTPS requests as the same object?
Accepted AnswerDoes transferring HTTP payload in multiple chunks to s3 count as multiple requests in term of pricing ?
asked a month agos3 create Presigned Multipart Upload URL using API
asked 2 months agoConfused between put request pricing and data transfer in pricing
asked 3 years agoS3 performance problems: How can i achieve a s3 request rate above the limit of 3500 PUT per second with multiple prefixes?
asked 2 months agoMultiple API keys and the flow rate limit in the usage plan
Accepted Answerasked 2 years ago