DMS Sync Issues with nullable column and new columns

0

IHAC who is facing a couple of sync issues: Say we have a table T on mysql src db with a column C that is nullable. The table is fully loaded on the target and the DMS task is operating in CDC mode. If this table T gets altered so column C is made not nullable with a default, this change does not propagate , nor does the DMS task indicate an error. In addition, any new columns added to table T on the source, also do not propagate. When the DMS task is operating in CDC mode, new tables that are created without a Primary Key do not propagate to the target. It can break DMS replication (error shows in logs). Thank you

profile pictureAWS
已提問 2 年前檢視次數 2411 次
2 個答案
0

Hello,

this is a documented limitation of CDC for MySQL as a source: https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MySQL.html#CHAP_Source.MySQL.Limitations

已回答 2 年前
  • Would this also apply to Aurora MySQL as a source? Customer has Aurora MySQL

0

Hello,

--> In general, DMS supports below DDL: [+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.SupportedDDL.html

--> Using MySQL(on-prem/Aurora MySQL/RDS MySQL) as source having limitation: "However, DROP TABLE, RENAME TABLE, and updates made to other attributes, such as column default value, column nullability, character set and so on, are not supported." [+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MySQL.html#CHAP_Source.MySQL.Limitations

--> If create table or add column not working properly, will need to dive deep into the issue using DMS log with detailed debug on SOURCE_CAPTURE, TASK_MANAGER, TARGET_APPLY to check further.

Note: "Using an ALTER TABLE table_name ADD COLUMN column_name statement to add columns to the beginning (FIRST) or the middle of a table (AFTER) isn't supported. Columns are always added to the end of the table."

--> What are the target/source endpoints:

Engine version (source and target) DMS version -- Check release note see if any known issues

--> Go through the current limitations and documentations to verify further. [+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MySQL.html

AWS
支援工程師
Kevin_Z
已回答 2 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南