progressive AW S3 folder download support as much the local file storage allows

0

Hi ,

I need to download the AWS s3 folder progressively that means if the local file storage is less than the actual AWS s3 folder then the S3 folder download should happen as much as the file storage allows .

It can also be related to the partial download in case if the file storage is not as much as the AWD s3 folder size.

Please help with the suggestions and inputs on the AWS s3 folder download as per the local file storage available .

  • Do you mean recursive download ?

  • @Omid Eidivandi It can also be related to the partial download in case if the file storage is not as much as the AWD s3 folder size.

preguntada hace 2 años258 visualizaciones
1 Respuesta
0

I m not sure about how you download files using cli or sdk or a third party library

If you prefere to use the cli simply

aws s3 cp s3://mybucket/directory mylocaldirectory --recursive

This way your command will result an error when no local disk is available in this case after solving the issue using --recursive will be handy

If you prefere using sdk you need to handle pagination and recursive download as I know

Wish that helps

respondido hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas