How to Concurrent upload of docs to S3 and use SQS to process it

0

Hi,

We are basically trying to make use of SQS to process the upload request to S3 as we get simultaneously many requests for upload during the peak hours. As application is hosted on elastic beanstalk with auto scaling , it manages to an extent but we need to make the upload much faster and smooth typically file size ranges from 50MB to 100MB

Any ideas on infrastructure or ref’s to follow?

We came across the worker environment of elastic beanstalk but not sure if it’ll solve the problem. So we are also thinking to make a serverless architecture using lambda , SQS and S3

Any help really appreciated. Thanks

1 Answer
0

Hi,

S3 can easily manage concurrent uploads

You have to POST docs directly to "S3 Signed URLs" generated by your application

profile picture
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions