DMS Sync Issues with nullable column and new columns

Question

IHAC who is facing a couple of sync issues:
Say we have a table T on mysql src db with a column C that is nullable. The table is fully loaded on the target and the DMS task is operating in CDC mode. If this table T gets altered so column C is made not nullable with a default, this change does not propagate , nor does the DMS task indicate an error.
In addition, any new columns added to table T on the source, also do not propagate. When the DMS task is operating in CDC mode, new tables that are created without a Primary Key do not propagate to the target. It can break DMS replication (error shows in logs).
Thank you

Answer

Hello,

this is a documented limitation of CDC for MySQL as a source:
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MySQL.html#CHAP_Source.MySQL.Limitations

Answer

Hello,

--> In general, DMS supports below DDL:
[+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.SupportedDDL.html

--> Using MySQL(on-prem/Aurora MySQL/RDS MySQL) as source having limitation:
"However, DROP TABLE, RENAME TABLE, and updates made to other attributes, such as column default value, column nullability, character set and so on, are not supported." [+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MySQL.html#CHAP_Source.MySQL.Limitations

--> If create table or add column not working properly, will need to dive deep into the issue using DMS log with detailed debug on SOURCE_CAPTURE, TASK_MANAGER, TARGET_APPLY to check further.

Note: "Using an ALTER TABLE table_name ADD COLUMN column_name statement to add columns to the beginning (FIRST) or the middle of a table (AFTER) isn't supported. Columns are always added to the end of the table."

--> What are the target/source endpoints:

Engine version (source and target)
DMS version -- Check release note see if any known issues

--> Go through the current limitations and documentations to verify further. [+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MySQL.html

DMS Sync Issues with nullable column and new columns

Relevant questions

AWS Glue problems reading from PostgreSQL DB that has uppercased table and column names

Having issues selecting columns in Timestream->Scheduled query - Can't save the query

AWS DMS doing a SELECT on TEXT column during continuous replication

Table id found in `stl_load_errors` doesn't correspond to loaded table