Changing EFS filesystems from General Performance to Max I/O
I need to to change an EFS filesystem from General Performance to Max I/O. The only way to do this is to create a new FS and use DataSync to copy the data. EFS is the underlying storage for my EKS cluster.
My approach is to:
- create the new FS.
- copy the data with DataSync.
- Stop services on the EKS cluster.
- Change the mount points on the CSI Driver.
- Restart application services.
Is the best approach? Or are there other documented steps to change EFS filesystems with an EKS cluster.
Thanks in advance.
Today, the approach you have outlined with DataSync is likely best. EFS Replication would be a perfect fit for this, but it currently doesn't support replicating to a filesystem with a different Performance Mode.
You can also use a client that has both filesystems mounted and rsync the data over, but then you will need to perform an initial transfer and then do an incremental sync during the cutover. DataSync will do this automatically.
Investigating this further, I have over 26 million files in my current FS. DataSync will not work, it has a quota limit of 25 million files when copying between AWS services.
I'll look into using R-Sync. But this might require more downtime!!
The option is to create a new EFS file system with the desired performance mode and then you can migrate data. Approaches in migrating data include using traditional copy, using AWS Datasync or using AWS Backup to perform a Backup and then restore it to a newer filesystem with performance mode desired.
References: https://docs.aws.amazon.com/efs/latest/ug/performance.html#performancemodes https://docs.aws.amazon.com/efs/latest/ug/trnsfr-data-using-datasync.html https://docs.aws.amazon.com/efs/latest/ug/awsbackup.html
Using ACL or NFSACL with EFSasked 2 months ago
Change EFS storage classes availability from Regional to One zoneAccepted Answerasked 2 months ago
Is there an option to create an EFS from an EBS snapshot?Accepted Answerasked 3 months ago
How to get comparable performance to gp2/gp3 on EFS?Accepted Answerasked 4 months ago
Send efs backup to S3Accepted Answerasked 5 months ago
Customer looking for cost effective way to migrate 200TB of files to EFS IA directlyAccepted Answerasked 2 months ago
Is it possible to make EFS publicly accessible?asked 4 months ago
Changing EFS filesystems from General Performance to Max I/Oasked 2 months ago
What is the total number of EFS volumes that can be created in a VPC?asked 3 months ago
Best way to expose files from EFS over HTTP(S)?asked 7 months ago