How do I debug RDS Mysql Disk stalls?

Question

We have fairly large RDS MySQL 5.7 instance. Once in a few days we see few seconds of DB error spikes. Usually it related to high DiskIO latency and Queue depth. I have checked the total IOPS is below provisioned IOPS and their no sudden jump in disk throughput as well. Doesn't look like we are microbursting or under provisioned.
Is this some temporary hardware issue that only AWS has visibility into? How do we go about debugging further?

![Enter image description here](/media/postImages/original/IM_oQwAU1VSjytXhqb8X3o3Q) ![Enter image description here](/media/postImages/original/IMOIQGCI3SRsalUWWFVwMpdw) ![Enter image description here](/media/postImages/original/IMoeftJOm3Tn-WIfjQrmYbsA)
![Enter image description here](/media/postImages/original/IMZM4RjDwqTvWOlu21Bt4z9w) ![Enter image description here](/media/postImages/original/IMjpZyUagBQ4OzknoUb3ZVWg)

Answer

You can refer [How do I troubleshoot the latency of Amazon EBS volumes caused by an IOPS bottleneck in my Amazon RDS instance?](https://repost.aws/knowledge-center/rds-latency-ebs-iops-bottleneck) and [How do I troubleshoot write latency spikes in my Amazon RDS DB instance?](https://repost.aws/knowledge-center/rds-write-latency-spikes) to collect all the required information. Using this information you can raise a support case to get it further investigated by a Support engineer for any internal storage issue if none of the metrics are experiencing any bottlenecks.

Hope it helps and if it does, I would appreciate if answer can be accepted so that community can benefit for clarity when searching for similar enquirers in Repost, thank you ;)

How do I debug RDS Mysql Disk stalls?

相关内容