Changing EFS filesystems from General Performance to Max I/O
Hi Experts,
I need to to change an EFS filesystem from General Performance to Max I/O. The only way to do this is to create a new FS and use DataSync to copy the data. EFS is the underlying storage for my EKS cluster.
My approach is to:
- create the new FS.
- copy the data with DataSync.
- Stop services on the EKS cluster.
- Change the mount points on the CSI Driver.
- Restart application services.
Is the best approach? Or are there other documented steps to change EFS filesystems with an EKS cluster.
Thanks in advance.
Today, the approach you have outlined with DataSync is likely best. EFS Replication would be a perfect fit for this, but it currently doesn't support replicating to a filesystem with a different Performance Mode.
You can also use a client that has both filesystems mounted and rsync the data over, but then you will need to perform an initial transfer and then do an incremental sync during the cutover. DataSync will do this automatically.
The option is to create a new EFS file system with the desired performance mode and then you can migrate data. Approaches in migrating data include using traditional copy, using AWS Datasync or using AWS Backup to perform a Backup and then restore it to a newer filesystem with performance mode desired.
References: https://docs.aws.amazon.com/efs/latest/ug/performance.html#performancemodes https://docs.aws.amazon.com/efs/latest/ug/trnsfr-data-using-datasync.html https://docs.aws.amazon.com/efs/latest/ug/awsbackup.html
Relevant questions
Using ACL or NFSACL with EFS
asked 6 months agoChanging EFS filesystems from General Performance to Max I/O
Accepted Answerasked 6 months agoEFS high metadata IO
asked 4 months agoone way data sync between ebs to efs
asked 2 months agoChange EFS storage classes availability from Regional to One zone
Accepted Answerasked 6 months agoEFS to s3 DataSync task failed to access location
asked 10 days agoIs there an option to create an EFS from an EBS snapshot?
Accepted Answerasked 7 months agoHow to get comparable performance to gp2/gp3 on EFS?
Accepted Answerasked 8 months agoBest way to expose files from EFS over HTTP(S)?
asked a year agoIs it possible to make EFS publicly accessible?
asked 8 months ago
Investigating this further, I have over 26 million files in my current FS. DataSync will not work, it has a quota limit of 25 million files when copying between AWS services.
I'll look into using R-Sync. But this might require more downtime!!