- Newest
- Most votes
- Most comments
Today, the approach you have outlined with DataSync is likely best. EFS Replication would be a perfect fit for this, but it currently doesn't support replicating to a filesystem with a different Performance Mode.
You can also use a client that has both filesystems mounted and rsync the data over, but then you will need to perform an initial transfer and then do an incremental sync during the cutover. DataSync will do this automatically.
The option is to create a new EFS file system with the desired performance mode and then you can migrate data. Approaches in migrating data include using traditional copy, using AWS Datasync or using AWS Backup to perform a Backup and then restore it to a newer filesystem with performance mode desired.
References: https://docs.aws.amazon.com/efs/latest/ug/performance.html#performancemodes https://docs.aws.amazon.com/efs/latest/ug/trnsfr-data-using-datasync.html https://docs.aws.amazon.com/efs/latest/ug/awsbackup.html
Please note that General Purpose performance mode has been improved to support up to hundreds of thousands IOPS. Due to the higher per-operation latencies with Max I/O, EFS recommends using General Purpose performance mode for all file systems.
For latest EFS performance, please refer to https://docs.aws.amazon.com/efs/latest/ug/performance.html
Relevant content
- asked 2 years ago
- asked 2 years ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated 10 months ago
- AWS OFFICIALUpdated 9 months ago
Investigating this further, I have over 26 million files in my current FS. DataSync will not work, it has a quota limit of 25 million files when copying between AWS services.
I'll look into using R-Sync. But this might require more downtime!!