DMS slow CDC apply

0

Customer is using DMS to replicate data from Aurora Postgresql to Oracle on-premise database using data load + CDC. Data load works well, it takes about 1 minute to migrate all existing data, but CDC is very slow. Meanwhile replication instance load is very low (free CPU, free RAM). Customer investigated the issue and found out that ingestion from source database is fast and the issue is about slow apply to the target Oracle database. Could you please advice where to start looking for the root cause and what it might be?

1개 답변
0

Have they tried to work on best practices? There are several very key best practices to improve the performance. https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html

  1. Migrating large binary objects (LOBs), Large object migration has a low performance. You can also look at row filtering https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.LargeTables
  2. Reducing the load on your source database and target, Did you check how is the metrics in the target database? if that is ingress slowly, perhaps this is related to a number of reasons. e.g. network connection from DB to on-prem, slow query etc. There is a network architecture below about on-prem for ref https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.Rte53DNSResolver
  3. It is always recommended to have multiple DMS job replicating across multiple table instead of having one DMS for whole database
  4. You can also check out the batch apply mode, however, be careful to the limitation listed. Some AWS doc also mentioned with the batch optimized apply option, loading into the net changes table uses a direct path, which doesn't support XML type. As a workaround, you can use transactional apply mode. https://repost.aws/knowledge-center/dms-batch-apply-cdc-replication
  5. Golden Gate is another third party option for oracle related migration https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Appendix.OracleGoldenGate.html
AWS
답변함 7달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인