DMS slow CDC apply

0

Customer is using DMS to replicate data from Aurora Postgresql to Oracle on-premise database using data load + CDC. Data load works well, it takes about 1 minute to migrate all existing data, but CDC is very slow. Meanwhile replication instance load is very low (free CPU, free RAM). Customer investigated the issue and found out that ingestion from source database is fast and the issue is about slow apply to the target Oracle database. Could you please advice where to start looking for the root cause and what it might be?

AWS
gefragt vor 7 Monaten483 Aufrufe
1 Antwort
0

Have they tried to work on best practices? There are several very key best practices to improve the performance. https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html

  1. Migrating large binary objects (LOBs), Large object migration has a low performance. You can also look at row filtering https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.LargeTables
  2. Reducing the load on your source database and target, Did you check how is the metrics in the target database? if that is ingress slowly, perhaps this is related to a number of reasons. e.g. network connection from DB to on-prem, slow query etc. There is a network architecture below about on-prem for ref https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.Rte53DNSResolver
  3. It is always recommended to have multiple DMS job replicating across multiple table instead of having one DMS for whole database
  4. You can also check out the batch apply mode, however, be careful to the limitation listed. Some AWS doc also mentioned with the batch optimized apply option, loading into the net changes table uses a direct path, which doesn't support XML type. As a workaround, you can use transactional apply mode. https://repost.aws/knowledge-center/dms-batch-apply-cdc-replication
  5. Golden Gate is another third party option for oracle related migration https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Appendix.OracleGoldenGate.html
AWS
beantwortet vor 7 Monaten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen