Aurora MySQL table not returning all rows

Question

We migrate data views from a MongoDB collection into AWS with an Aurora MySQL table as the endpoint. In the migration task, all of the rows are being sent and logged as the target endpoint receiving the rows, but when I query the table it comes back with almost 400 less rows than expected. One issue I investigated is making sure the field that we use as the primary key holds unique values in the mongo data view, and as expected all values are unique. What other issues could possibly cause this to happen?

Answer

Hello,

* Please check the task logs to see if there were any errors.

* In some cases, DMS encounters errors when performing DML (INSERT) on the target endpoint, and this information is recorded in the dmslogs.awsdms_apply_exceptions table on the target endpoint. Thus, I would kindly suggest you to query the 'awsdms_apply_exceptions' table to check for any issues.

[+] Control table task settings - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.TaskSettings.ControlTable.html

Additionally, please refer to the documents below that would be helpful in troubleshooting the issue that you are facing :
* How can I troubleshoot data mismatch issues between the source and target databases in AWS DMS? - https://repost.aws/knowledge-center/dms-source-target-data-mismatch
* Troubleshooting migration tasks in AWS Database Migration Service - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Troubleshooting.html

Thank you!

Aurora MySQL table not returning all rows

Relevant content