One way you could migrate files from your on-prem storage server (NFS) into your S3 buckets is by using AWS DataSync (https://aws.amazon.com/datasync/). Once you've seeded your bucket with data, you can use the same bucket(s) for access through AWS Transfer for SFTP.
Please let me know if you have any questions about this set up or run into issues.
Proposed solution with AWS DataSync seems reasonable, however we didnt choose it as a way to go. We were also thinking about using simple aws s3 sync command.
However in the end we will be transferring 10+ TB of data so we might end up with the AWS Snowball service. Thanks
Can you share your pros/cons of using Snowball over DataSync?
I guess most significant reason for snowball was the bandwith.
We couldnt consume all of 1Gbps bandwith just for this transfer and with limiting bandwith it would take at least 3 weeks to transfer 10+ TB and this is with the transfer running non-stop the entire time.
With the snowball this can be achieved in less time even with the shipping times included.
- AWS OFFICIALUpdated 7 months ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 9 months ago
- AWS OFFICIALUpdated 3 years ago
- EXPERTpublished 5 months ago
- EXPERTpublished 6 months ago