DMS Migration MongoDB source and RDS Postgres as destination
I want to start existing and ongoing replication from source MongoDB to destination RDS Postgres.
All the security network is done and successful.
- RDS VPC and DMS VPC are connected using VPC peering, target endpoint test connection status is successful
- DMS VPC IP is added in another AWS account MongoDB server, source endpoint test connection status is successful
- In the Endpoint schemas section both database schemas are visible.
Created a DMS migration task to start the migration of one document of MongoDB to Postgres Database.
- Premigration assessments were successful.
- Empty scheme with the MongoDB schema name got created in PostgresDB.
- The table awsdms_apply_execution is also empty in Postgres DB.
But the task shows running with error and error, and cloud watch logs also show no error.
hello there.
I hear the DMS task is running with errors. This could be due to multiple reasons. Please kindly ensure check the below:
DMS task table statistics. This will help see which tables failed Full Load phase as this can cause "running with errors"
Turn on logging level to detailed debug for SOURCE_UNLOAD and TARGET_LOAD to see more information on table failures.
Ensure that the DMS replication instance has enough resource for the DMS task (.i.e. CPU, Storage, Memory)
Filter through the DMS task log and try find log entry with "]E:" or "]W:" this will display DMS task errors and warnings.
If the above does not work, please try testing with a Full load only DMS task. If the issue persists further please open a support case with AWS Premium Support to get an in-depth look at the DMS task failure
references:
to migrate using MongoDB as a source for AWS DMS for example there are permissions needed which can be found in the below document and other requirements too can be found on the below document
[1]https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.MongoDB.html
to migrate using postgres as a target there are also requirements that needs to be considered can be found on document below
[1]https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.PostgreSQL.html
Relevant questions
DMS Migration MongoDB source and RDS Postgres as destination
Accepted Answerasked 20 days agoResolution for Fatal error when using DMS for on-going replication from RDS Postgres to S3
Accepted Answerasked a year agoUnable to use plugins to establish logical replication on source PostgreSQL
asked 2 years agoDMS supports Super type for Redshift target with MongoDB source
asked 2 months agoaurora serverless as source and destination for DMS
Accepted AnswerOngoing replication from MongoDB to RDS PostgresSQL
Accepted Answerasked 12 days agoAWS DMS Source MongoDB and Target RDS Postgres Full load not happening but ongoing replication happens
Accepted Answerasked 7 days agoRDS/DynamoDB/DMS questions
Accepted Answerasked 3 years agoApplying column filters in DMS Task for source MongoDB and target Postgres
asked 19 days agoAWS DMS CDC task with Mongodb as source fails
asked a month ago