upload larger file with same ps

Question

Hi team,

In my solution, I am generating a presigned URL for a backend client application to upload a file to my S3 bucket. However, the backend client application has a limitation: it cannot upload more than 2 MB at once. We need to upload larger files exceeding this 2 MB limit.

Is there a way to overcome this limitation while still using the presigned URL solution, or we should move to another approach?

Thank you!

AWS TAM · Answer

To overcome the 2 MB file size limitation in your backend client application while still using the presigned URL solution, you can consider the following approaches:

Multipart Upload: Amazon S3 supports the Multipart Upload API, which allows you to upload large objects in parts. This can be useful when uploading files larger than 2 MB. You can use the AWS SDK or AWS CLI to implement the Multipart Upload process.

Example AWS CLI command for Multipart Upload:

aws s3 mb s3://your-bucket-name
    aws s3 mv local-file.txt s3://your-bucket-name/remote-file.txt --multipart-upload

Streaming Uploads: Instead of uploading the entire file at once, you can stream the file data to S3 using a presigned URL. This can help overcome the 2 MB limitation by sending the data in smaller chunks.

https://aws.amazon.com/blogs/compute/uploading-large-objects-to-amazon-s3-using-multipart-upload-and-transfer-acceleration/

upload larger file with same ps

Add your answer

Relevant content