Changing EFS filesystems from General Performance to Max I/O

0

Hi Experts,

I need to to change an EFS filesystem from General Performance to Max I/O. The only way to do this is to create a new FS and use DataSync to copy the data. EFS is the underlying storage for my EKS cluster.

My approach is to:

  1. create the new FS.
  2. copy the data with DataSync.
  3. Stop services on the EKS cluster.
  4. Change the mount points on the CSI Driver.
  5. Restart application services.

Is the best approach? Or are there other documented steps to change EFS filesystems with an EKS cluster.

Thanks in advance.

3 Answers
0
Accepted Answer

Today, the approach you have outlined with DataSync is likely best. EFS Replication would be a perfect fit for this, but it currently doesn't support replicating to a filesystem with a different Performance Mode.

You can also use a client that has both filesystems mounted and rsync the data over, but then you will need to perform an initial transfer and then do an incremental sync during the cutover. DataSync will do this automatically.

AWS
kdavyd
answered 2 years ago
profile picture
EXPERT
reviewed a month ago
  • Investigating this further, I have over 26 million files in my current FS. DataSync will not work, it has a quota limit of 25 million files when copying between AWS services.

    I'll look into using R-Sync. But this might require more downtime!!

0

The option is to create a new EFS file system with the desired performance mode and then you can migrate data. Approaches in migrating data include using traditional copy, using AWS Datasync or using AWS Backup to perform a Backup and then restore it to a newer filesystem with performance mode desired.

References: https://docs.aws.amazon.com/efs/latest/ug/performance.html#performancemodes https://docs.aws.amazon.com/efs/latest/ug/trnsfr-data-using-datasync.html https://docs.aws.amazon.com/efs/latest/ug/awsbackup.html

AWS
answered 2 years ago
0

Please note that General Purpose performance mode has been improved to support up to hundreds of thousands IOPS. Due to the higher per-operation latencies with Max I/O, EFS recommends using General Purpose performance mode for all file systems.

For latest EFS performance, please refer to https://docs.aws.amazon.com/efs/latest/ug/performance.html

AWS
yuffiez
answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions