progressive AW S3 folder download support as much the local file storage allows

Question

Hi ,

I need to download the AWS s3 folder progressively that means if the local file storage is less than the actual AWS s3 folder then the S3 folder download should happen as much as the file storage allows .

It can also be related to the partial download in case if the file storage is not as much as the AWD s3 folder size.

Please help with the suggestions and inputs on the AWS s3 folder download as per the local file storage available .

Answer

I m not sure about how you download files using cli or sdk or a third party library

If you prefere to use the cli simply

```
aws s3 cp s3://mybucket/directory mylocaldirectory --recursive
```
This way your command will result an error when no local disk is available in this case after solving the issue using --recursive will be handy

If you prefere using sdk you need to handle pagination and recursive download as I know

Wish that helps

progressive AW S3 folder download support as much the local file storage allows

相关内容