How to Concurrent upload of docs to S3 and use SQS to process it

0

Hi,

We are basically trying to make use of SQS to process the upload request to S3 as we get simultaneously many requests for upload during the peak hours. As application is hosted on elastic beanstalk with auto scaling , it manages to an extent but we need to make the upload much faster and smooth typically file size ranges from 50MB to 100MB

Any ideas on infrastructure or ref’s to follow?

We came across the worker environment of elastic beanstalk but not sure if it’ll solve the problem. So we are also thinking to make a serverless architecture using lambda , SQS and S3

Any help really appreciated. Thanks

1 Respuesta
0

Hi,

S3 can easily manage concurrent uploads

You have to POST docs directly to "S3 Signed URLs" generated by your application

profile picture
respondido hace un año

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas