By using AWS re:Post, you agree to the Terms of Use
/DMS task is creating full row duplicates in target/

DMS task is creating full row duplicates in target


Hi, I have a DMS task to move data from Oracle CDC to Redshift. (Full Load and ongoing changes). During the full load, the task just keeps on running and is not reaching a 100%. In the target, I can see the row count is already 4 times the row count in the source. There are 4x full row duplicates in the target. Can anyone please guide what could be the issue here and how to debug? thnx.

1 Answers

Hi ,

have you looked at the DMS logs for the task?

AWS DMS restarts table loading from the beginning when it hasn't finished the initial load of a table. When a task is restarted, AWS DMS reloads tables from the beginning when the initial load didn't complete.

As described here.

The recoverable error count is by default -1 (restart indefinitely) so if any error happens the task might restart and reload all the tables. With no PK enforcing (as in Redshift) you will see the duplicates.

hope this helps

answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions