How to Concurrent upload of docs to S3 and use SQS to process it

0

Hi,

We are basically trying to make use of SQS to process the upload request to S3 as we get simultaneously many requests for upload during the peak hours. As application is hosted on elastic beanstalk with auto scaling , it manages to an extent but we need to make the upload much faster and smooth typically file size ranges from 50MB to 100MB

Any ideas on infrastructure or ref’s to follow?

We came across the worker environment of elastic beanstalk but not sure if it’ll solve the problem. So we are also thinking to make a serverless architecture using lambda , SQS and S3

Any help really appreciated. Thanks

1 Risposta
0

Hi,

S3 can easily manage concurrent uploads

You have to POST docs directly to "S3 Signed URLs" generated by your application

profile picture
con risposta un anno fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande