AWS Builder Center is the official home for builders on AWS. Share and read what others are working on, follow people who inspire you, explore training and workshops, and find tools to support what you're building.
AWS DMS Failing to Migrate Tables with LOBs and JSONB Columns
I’m using AWS DMS to migrate a Postgres database between two RDS instances (both Postgres 12.17). Most tables migrate successfully, but tables with LOBs and JSONB columns (public.contract and public.user) keep failing. The DMS task suspends with errors like:
Table 'public.contract' was errored/suspendedFailed to load data from csv file.Handling End of table loading failed by subtask 1 thread 1.
Steps Taken:
- Switched to Full LOB mode with no size limit.
- Increased DMS instance to dms.r5.xlarge.
- Checked JSONB column size (small, only 5 bytes).
- Adjusted DMS timeouts and retries.
Key Questions:
- Is there an issue with non-optimized Full LOB mode causing these suspensions?
- Any DMS tuning tips to handle LOBs/JSONB better?
- Could the problem be related to target database resource limits?
Any insights or solutions are greatly appreciated. Thanks!
- Language
- English
asked 2 years ago957 views
- Newest
- Most votes
- Most comments
Hi,
Re JSONB and LOB columns, are they nullable in target DB? As per doc, they must be so.
See https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.LOBS for all details
Best,
Didier
check the target postgres.log there would be more details about the error.
answered 2 years ago
Thank you so much. This helps.
Yusuf, you're very welcome! Thanks for accepting my answer