DMS Job Error. from mongodb to documentdb

Question

2021-01-14T23:00:59.000+08:00	2021-01-14T15:00:59 \[AT_GLOBAL ]I: Task Server Log - 3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA (V3.4.3.R1 localhost.localdomain Linux 4.14.59-64.43.amzn1.x86_64 #1 SMP Thu Aug 2 21:29:33 UTC 2018 x86_64 64-bit, PID: 26697) started at Thu Jan 14 15:00:59 2021 (at_logger.c:2700)  
  
2021-01-14T23:00:59.000+08:00	2021-01-14T15:00:59 \[DATA_STRUCTURE ]I: SQLite version is 3.31.1 (at_sqlite.c:174)  
  
2021-01-14T23:00:59.000+08:00	2021-01-14T15:00:59 \[VALIDATOR ]I: validation_util_class_initialize (validation_util.c:70)  
  
2021-01-14T23:00:59.000+08:00	2021-01-14T15:00:59 \[VALIDATOR ]I: Creating Table Def Mutex (validation_util.c:74)  
  
2021-01-14T23:00:59.000+08:00	2021-01-14T15:00:59 \[VALIDATOR ]I: ==> Success Creating Table Def Mutex (validation_util.c:82)  
  
2021-01-14T23:00:59.000+08:00	2021-01-14T15:00:59 \[COMMON ]D: at_common_is_supported: load_common_wrapper( common_load_locker ) failed (at_common.c:69)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]I: Execute Request Task '3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA' running full load and CDC with flags fresh start with cdcPosition null and stop_at null (replicationtask.c:753)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]I: BatchApplyPreserveTransaction is set to false, because BatchApplyEnabled is false (replicationtask.c:1100)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]I: Task '3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA' starting full load and CDC in fresh start mode (replicationtask.c:1312)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]W: The "Transactional apply" option is not available when MongoDB is the target endpoint. The "Batch optimized apply" option will be used instead. (replicationtask.c:1541)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]I: Task Id: 1df77829-2a03-4d26-ba83-941e13de6edb (replicationtask.c:3279)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]I: LOB support on the task has been enabled (endpointshell.c:1792)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[TASK_MANAGER ]I: Task is running in Limited LOB Mode. MaxLobSize is set to '32768' Bytes (endpointshell.c:1795)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[METADATA_MANAGE ]I: Source endpoint 'mongoDB' is using provider syntax 'MongoDB' (provider_syntax_manager.c:622)  
  
2021-01-14T23:01:00.000+08:00	2021-01-14T15:01:00 \[METADATA_MANAGE ]I: Connection string: 'mongodb://172.16.3.147:27017/?retryWrites=false' (mongodb_imp.c:408)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[METADATA_MANAGE ]I: MongoDB version: 4.0.1 (mongodb_imp.c:210)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[METADATA_MANAGE ]I: Target endpoint 'mongoDB' is using provider syntax 'MongoDB' (provider_syntax_manager.c:628)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[METADATA_MANAGE ]I: Connection string: 'mongodb://mongo:****@inventorydb.cluster-c3jaqp3qyz8v.us-east-2.docdb.amazonaws.com:27017/?retryWrites=false&authSource=admin&authMechanism=SCRAM-SHA-1' (mongodb_imp.c:408)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[METADATA_MANAGE ]I: MongoDB version: 4.0.0 (mongodb_imp.c:210)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TASK_MANAGER ]I: Preparing all components (replicationtask.c:1935)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TASK_MANAGER ]I: Task - 3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA is in STARTING state, updating starting status to AR_PREPARING_COMPONENTS (repository.c:5111)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TASK_MANAGER ]I: Creating threads for all components (replicationtask.c:1968)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TASK_MANAGER ]I: Task - 3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA is in STARTING state, updating starting status to AR_CREATING_TREADS (repository.c:5111)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TASK_MANAGER ]I: Task - 3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA is in STARTING state, updating starting status to AR_CREATING_TABLES_LIST (repository.c:5111)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TABLES_MANAGER ]I: Calling for get capture table list from the Metadata Manager started. (tasktablesmanager.c:928)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TABLES_MANAGER ]I: Calling for get capture table list from the Metadata Manager ended. (tasktablesmanager.c:935)  
  
2021-01-14T23:01:01.000+08:00  
  
复制  
2021-01-14T15:01:01 \[TASK_MANAGER    ]E:  No tables were found at task initialization. Either the selected table(s) no longer exist or no match was found for the table selection pattern(s). \[1021707]  (replicationtask.c:2107)  
2021-01-14T15:01:01 \[TASK_MANAGER ]E: No tables were found at task initialization. Either the selected table(s) no longer exist or no match was found for the table selection pattern(s). \[1021707] (replicationtask.c:2107)  
  
2021-01-14T23:01:01.000+08:00	2021-01-14T15:01:01 \[TASK_MANAGER ]E: Task '3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA' failed \[1021707] (replicationtask.c:3316)  
  
2021-01-14T23:01:30.000+08:00	2021-01-14T15:01:30 \[TASK_MANAGER ]I: Task - 3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA is in ERROR state, updating starting status to AR_NOT_APPLICABLE (repository.c:5103)  
  
2021-01-14T23:01:30.000+08:00	2021-01-14T15:01:30 \[TASK_MANAGER ]E: Task '3DD5OUFBJIVNLDZTIWAKBVENSW3SDHDKLOXO7YA' encountered a fatal error (repository.c:5196)  
  
2021-01-14T23:01:33.000+08:00	2021-01-14T15:01:33 \[METADATA_MANAGE ]I: Destroying mongoc client: '23271072968192' (mongodb_imp.c:1153)  
  
2021-01-14T23:01:33.000+08:00	2021-01-14T15:01:33 \[METADATA_MANAGE ]I: Destroying mongoc client: '23271073330768' (mongodb_imp.c:1153)  
  
2021-01-14T23:01:40.000+08:00	2021-01-14T15:01:40 \[TASK_MANAGER ]I: Task Management thread terminated abnormally (replicationtask.c:3969)  
  
2021-01-14T23:01:40.000+08:00	2021-01-14T15:01:40 \[AT_GLOBAL ]I: Closing log file at Thu Jan 14 15:01:40 2021 (at_logger.c:2548)

Answer

**Source** : MariaDB  
**Destination** : Kinesis Stream  
  
**Behavior** : Worked first time only.  
**Same Error subsequently** :  
Last Error No tables were found at task initialization. Either the selected table(s) or schemas(s) no longer exist or no match was found for the table selection pattern(s). If you would like to start a Task that does not initially capture any tables, set Task Setting FailOnNoTablesCaptured to false and restart task. Stop Reason FATAL_ERROR Error Level FATAL  
  
Also fails with wild card (%).   
No response from AWS Premium Support.

Answer

Hi,

I was also facing the same issue when I tried to do the same with Oracle DB as the source and S3 buckets as the target. But I was able to figure out the issue after a long time. The issue is due to privileges that are mandatory for the respective DMS user in which one of the main privileges was missed out initially during my migration task, I think you can try replicating that in your case also. I hope it might solve it. I have mentioned below the necessary privilege that has to enabled apart from the ones that are common.

For the migration of tables, it is mandatory that you enable the following privilege on each table.

GRANT SELECT on <schema>.<table> to <dms_user>;

I believe you were getting the error because the privilege is not enabled on the table that you are trying to migrate, I hope this is helpful.

Thanks
Vishnu N

DMS Job Error. from mongodb to documentdb

Relevant content