How to recover from invalid resume token on DMS MongoDB connector?

Question

When we pause our mongo connections on DMS for some hours and the resume point is no longer in the oplog we are unable to restart or resume our task.

Is there any way we can ignore these errors and continue replication or setup a hearbeat similar to Postgres RDS endpoint to update the resume point?
The only fix we found was deleting the task and recreating it.

```
Resume of change stream was not possible, as the resume point may no longer be in the oplog
```

Answer

Above error basically means the last oplog position when the dms task was stopped is no longer and there are chances of data loss due to missing transactions. I would suggest increasing the oplog so that the required entry postion is not overwritten

https://www.mongodb.com/docs/manual/tutorial/change-oplog-size/#c.-change-the-oplog-size-of-the-replica-set-member

How to recover from invalid resume token on DMS MongoDB connector?

相關內容