[DMS] Full Lob tasks lost connection

0

Hello, Im trying to migrate a large table with lobs. Scenário Master with Multi-AZ + RO Réplica Full Load + CDC

I set all timeout strings referenced in documentation. ignore foreign keys

DMs instance: dms.r5.xlarge

Errors:

  • DMS dont start populating new database
  • Mysql Connection Lost
  • Lost connection to MySQL server during query
  • Replication task has failed. Reason: Last Error Failed to connect to database. Stop Reason RECOVERABLE_ERROR Error Level RECOVERABLE.
  • [SOURCE_UNLOAD ]E: Connection error [1022506] (mysql_endpoint_imp.c:115)
  • Reloading table 21 because subtask #1 finished with error (replicationtask.c:2559)
  • Task error notification received from subtask 1, thread 0, status 1020414 (replicationtask.c:3400)

Target config: { "MaxFileSize": 1073741824, "ParallelLoadThreads": 1, "ExecuteTimeout": 3600 }

Master RDS I cant: Full load only Full load = CDC

RO Replica I can: Full load

Database description Size: 8GB Rows: 15995900

Ps: i migrated several databses without lobs with successful

質問済み 2ヶ月前123ビュー
2回答
2
承認された回答

Please try the following:

  • Set Timeout Strings: Ensure that all timeout settings referenced in the documentation are properly configured to accommodate the migration of large tables with LOBs. Pay particular attention to connection and execution timeouts.
  • Ignore Foreign Keys: Consider disabling foreign key constraints during the migration process to prevent potential issues related to referential integrity.
  • Optimize DMS Instance: Verify that the DMS instance (e.g., dms.r5.xlarge) has adequate resources to handle the migration workload. Consider scaling up the instance if necessary to improve performance.
  • Address Connection Issues: Investigate and address any MySQL connection issues, such as "Connection Lost" errors or "Lost connection to MySQL server during query" messages. This may involve optimizing network settings, adjusting connection parameters, or troubleshooting connectivity issues.
  • Check Replication Task Configuration: Review the replication task configuration, including parameters such as MaxFileSize and ParallelLoadThreads, to ensure they are appropriately set for the migration workload. Adjust these parameters as needed to optimize performance.
  • Troubleshoot Failed Tasks: Analyze error messages related to failed replication tasks, such as "Failed to connect to database" or "Connection error [1022506]." Look for patterns or common issues that may indicate the root cause of the problem.
  • Consider Full Load Only: If encountering persistent issues with CDC (Change Data Capture), consider using full load migration instead of CDC for the primary RDS instance. For read-only replica instances, full load migration may be sufficient.
  • Monitor Resource Usage: Continuously monitor resource usage on both the source and target databases during the migration process. Look for any signs of resource contention or bottlenecks that may impact performance.
  • Review Datbase Size and Structure: Validate the size and structure of the database, including the size of the table being migrated (e.g., 8GB with 15,995,900 rows). Ensure that the database schema is compatible with DMS migration.
profile picture
エキスパート
回答済み 2ヶ月前
profile picture
エキスパート
レビュー済み 2ヶ月前
0

Thanks for the answer, I found a microservice that limits queries to 6m on Master Database.

回答済み 2ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ