Slow Data Throughput using Robocopy and FSx Filesystem for Windows File Servers

0

I could use some guidance on improving data transfer speeds while using Robocopy to copy data into an FSx filesystem. Some details

Data source is outside AWS cloud (However, transfer tests from an EC2 instance in same subnet was below par)

No Direct Connect but provisioned network throughput into AWS is not a bottleneck (confirmed with Diskspd)

FSx Filesystem uses SSD drives (yeah I tried HDD but SSD is not pulling its weight either.)

Robocopy parameters: disabled ACLs capture to rule out permissions errors; tried thread counts of 50 through 128; output redirected to log file; no restartable mode

Data throughput looks promising at the start but tails off after about an hour.

FS filesystem dashboard occasional generates a warning about Disk IOPS utilization (SSD); recommends I increase storage capacity even though there is plenty of free space after transfer is complete!

I tried DataSync. Performance was poor (I really did not expect much from an appliance acting as a data relay.)

Can anyone vouch for Robocopy as a tool for bulk data migrations into FSx from outside the AWS cloud?

질문됨 10달 전322회 조회
1개 답변
0

Hi,

Did you try to use following options ?

/J : Copy using unbuffered I/O
/NOOFFLOAD : Copy files without using the Windows Copy Offload mechanism.
profile pictureAWS
전문가
답변함 10달 전
  • I tried your suggestion but observed no improvement. After consulting with AWS support, apparently oversubscribing storage capacity is the "solution". Not cost-effective but then again the bulk transfers (with the need for speed) are temporary.

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인