By using AWS re:Post, you agree to the Terms of Use

progressive AW S3 folder download support as much the local file storage allows

0

Hi ,

I need to download the AWS s3 folder progressively that means if the local file storage is less than the actual AWS s3 folder then the S3 folder download should happen as much as the file storage allows .

It can also be related to the partial download in case if the file storage is not as much as the AWD s3 folder size.

Please help with the suggestions and inputs on the AWS s3 folder download as per the local file storage available .

  • Do you mean recursive download ?

  • @Omid Eidivandi It can also be related to the partial download in case if the file storage is not as much as the AWD s3 folder size.

asked a month ago34 views
1 Answers
0

I m not sure about how you download files using cli or sdk or a third party library

If you prefere to use the cli simply

aws s3 cp s3://mybucket/directory mylocaldirectory --recursive

This way your command will result an error when no local disk is available in this case after solving the issue using --recursive will be handy

If you prefere using sdk you need to handle pagination and recursive download as I know

Wish that helps

answered a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions