DMS slow CDC apply

0

Customer is using DMS to replicate data from Aurora Postgresql to Oracle on-premise database using data load + CDC. Data load works well, it takes about 1 minute to migrate all existing data, but CDC is very slow. Meanwhile replication instance load is very low (free CPU, free RAM). Customer investigated the issue and found out that ingestion from source database is fast and the issue is about slow apply to the target Oracle database. Could you please advice where to start looking for the root cause and what it might be?

AWS
preguntada hace 7 meses482 visualizaciones
1 Respuesta
0

Have they tried to work on best practices? There are several very key best practices to improve the performance. https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html

  1. Migrating large binary objects (LOBs), Large object migration has a low performance. You can also look at row filtering https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.LargeTables
  2. Reducing the load on your source database and target, Did you check how is the metrics in the target database? if that is ingress slowly, perhaps this is related to a number of reasons. e.g. network connection from DB to on-prem, slow query etc. There is a network architecture below about on-prem for ref https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.Rte53DNSResolver
  3. It is always recommended to have multiple DMS job replicating across multiple table instead of having one DMS for whole database
  4. You can also check out the batch apply mode, however, be careful to the limitation listed. Some AWS doc also mentioned with the batch optimized apply option, loading into the net changes table uses a direct path, which doesn't support XML type. As a workaround, you can use transactional apply mode. https://repost.aws/knowledge-center/dms-batch-apply-cdc-replication
  5. Golden Gate is another third party option for oracle related migration https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Appendix.OracleGoldenGate.html
AWS
respondido hace 7 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas