By using AWS re:Post, you agree to the Terms of Use

Questions tagged with AWS Database Migration Service

Sort by most recent

Browse through the questions and answers listed below or filter and sort to narrow down your results.

1
answers
0
votes
35
views
profile picture
asked 2 months ago

AWS DMS - FATAL_ERROR - Stream component failed at subtask - SQL Server to Redshift

Hello All I am migrating RDS for ms sql server to redshift and getting below error. When checked with 'Table Statistics', one of them is showing as 'Table error'. please advise to resolve the issue Error : Last failure message Last Error Fatal error has occurred Task error notification received from subtask 7, thread 0 [reptask/replicationtask.c:2883] [1022505] Error executing source loop; Stream component failed at subtask 7, component st_7_ORXNENHJMUOQANKGRR5D3EZGLL2UWEW2C5MXXZY; Stream component 'st_7_ORXNENHJMUOQANKGRR5D3EZGLL2UWEW2C5MXXZY' terminated [reptask/replicationtask.c:2891] [1022505] Stop Reason FATAL_ERROR Error Level FATAL please find the below cloudwatch logs and advise if there is any issue 2022-07-26T13:01:15 [SOURCE_UNLOAD ]E: RetCode: SQL_ERROR SqlState: 42000 NativeError: 102 Message: [Microsoft][ODBC Driver 17 for SQL Server][SQL Server]Incorrect syntax near 'FTP'. Line: 1 Column: -1 [1022502] (ar_odbc_stmt.c:3932) 2022-07-26T13:01:15 [SOURCE_UNLOAD ]E: sqlserver_fill_table_partitioners_names(...) Failed to create statement: select pf.name AS PartitionFunctionName, c.name AS PartitionKey FROM sys.dm_db_partition_stats AS pstats INNER JOIN sys.partitions AS p ON pstats.partition_id = p.partition_id INNER JOIN sys.destination_data_spaces AS dds ON pstats.partition_number = dds.destination_id INNER JOIN sys.data_spaces AS ds ON dds.data_space_id = ds.data_space_id INNER JOIN sys.partition_schemes AS ps ON dds.partition_scheme_id = ps.data_space_id INNER JOIN sys.partition_functions AS pf ON ps.function_id = pf.function_id INNER JOIN sys.indexes AS i ON pstats.object_id = i.object_id AND pstats.index_id = i.index_id AND dds.partition_scheme_id = i.data_space_id AND i.type <= 1 INNER JOIN sys.index_columns AS ic ON i.index_id = ic.index_id AND i.object_id = ic.object_id AND ic.partition_ordinal > 0 INNER JOIN sys.columns AS c ON pstats.object_id = c.object_id AND ic.column_id = c.column_id WHERE pstats.object_id = OBJECT_ID(N'[dbo].['FTP Actions International$']', N'table') group by pf.name, c.name [1022505] (sqlserver_endpoint_metadata.c:1517) 2022-07-26T13:01:15 [SOURCE_UNLOAD ]E: sqlserver_construct_select_statement(...) unable to resolve partitioners names for table dbo.'FTP Actions International$' [1022505] (sqlserver_endpoint_unload.c:637) 2022-07-26T13:01:15 [SOURCE_UNLOAD ]E: SQL Server source. Cannot init table workspace for iMetaDataTableid- '27' [1022505] (sqlserver_endpoint_unload.c:415) 2022-07-26T13:01:15 [SOURCE_UNLOAD ]E: Error executing source loop [1022505] (streamcomponent.c:1873) 2022-07-26T13:01:15 [TASK_MANAGER ]E: Stream component failed at subtask 4, component st_4_QQMN67PX7YCFOKBMLC6N2VUUZYDNUVLMALF3VBY [1022505] (subtask.c:1414) 2022-07-26T13:01:15 [SOURCE_UNLOAD ]E: Stream component 'st_4_QQMN67PX7YCFOKBMLC6N2VUUZYDNUVLMALF3VBY' terminated [1022505] (subtask.c:1594) 2022-07-26T13:01:15 [TASK_MANAGER ]W: Table 'dbo'.''FTP Actions International$'' (subtask 4 thread 0) is suspended (replicationtask.c:2550) 2022-07-26T13:01:15 [TASK_MANAGER ]I: Task - 2QFN76MQVCH2LN5WWULZTGTJJSH6Q6OBTQKHLLQ is in ERROR state, updating starting status to AR_NOT_APPLICABLE (repository.c:5102) 2022-07-26T13:01:15 [TASK_MANAGER ]E: Task error notification received from subtask 4, thread 0 [1022505] (replicationtask.c:2883) 2022-07-26T13:01:15 [TASK_MANAGER ]E: Error executing source loop; Stream component failed at subtask 4, component st_4_QQMN67PX7YCFOKBMLC6N2VUUZYDNUVLMALF3VBY; Stream component 'st_4_QQMN67PX7YCFOKBMLC6N2VUUZYDNUVLMALF3VBY' terminated [1022505] (replicationtask.c:2891) 2022-07-26T13:01:15 [TASK_MANAGER ]E: Task '2QFN76MQVCH2LN5WWULZTGTJJSH6Q6OBTQKHLLQ' encountered a fatal error (repository.c:5196)
1
answers
0
votes
63
views
asked 3 months ago

DMS task status not updated to failed.

Hello, We are using AWS DMS and we run into an issue. We are using DMS engine version 3.4.6 with Oracle 11.2.0.4 as source and PostgreSQL 13.3 destination. At some point during the on-going replication the table `public.awsdms_apply_exceptions` is dropped. Important precision: this table drop is was a mistake in our side. This status is correctly reported in the task's logs at `2022-07-18T10:09:51` (see below). But the tasks status is not updated to `failed` or another status than `Load complete, replication ongoing` in the DMS web dashboard whereas the log reports: ``` 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [TASK_MANAGER ]I: Task - PX242JWPJG2JGAF43IIYQOJGLRH2JIPSGHIMGWQ is in STOPPED state, updating starting status to AR_NOT_APPLICABLE (repository.c:5102) ``` The tasks *should be* updated to `failed`. Here is an extract of the end of the task log: ``` 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Connecting to Oracle: Beginning session (oracle_endpoint_conn.c:944) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Source endpoint 'Oracle' is using provider syntax 'Oracle' (provider_syntax_manager.c:623) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: Target components st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY was reattached after 6 seconds. (subtask.c:1393) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TASK_MANAGER ]I: Starting component st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY (subtask.c:1399) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: Table 'public'.'awsdms_apply_exceptions' does not exist, insufficient privileges or no supported columns [1022517] (ar_odbc_conn.c:2177) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: RetCode: SQL_ERROR SqlState: 42P01 NativeError: 1 Message: ERROR: relation "public.awsdms_apply_exceptions" does not exist; No query has been executed with that handle [1022502] (ar_odbc_conn.c:2277) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: Failed to get table public.awsdms_apply_exceptions definition [1022500] (odbc_util.c:1189) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [METADATA_MANAGE ]I: Metadata Manager table definition cannot be found. Table ID: 491. Component ID: DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY [1022500] (metadatamanager.c:1545) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: Failed to get table definition for exception table [1022500] (endpointshell.c:3454) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: Error executing command [1022500] (streamcomponent.c:1979) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TASK_MANAGER ]I: Stream component failed at subtask 0, component st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY [1022500] (subtask.c:1414) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [TARGET_APPLY ]I: Target component st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY was detached because of recoverable error. Will try to reattach (subtask.c:1537) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Disconnecting Oracle database (oracle_endpoint_conn.c:1385) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Disconnected Oracle database (oracle_endpoint_conn.c:1420) 2022-07-18T12:09:51.000+02:00 2022-07-18T10:09:51 [SORTER ]I: Final saved task state. Stream position 000000048BF51F4B02000001000124580003AFBC00100000000000048BF50F8F, Source id 12824386, next Target id 781961, confirmed Target id 0, last source timestamp 1658138988000000 (sorter.c:798) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [SOURCE_CAPTURE ]I: Disconnecting Oracle database (oracle_endpoint_conn.c:1385) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [SOURCE_CAPTURE ]I: Disconnected Oracle database (oracle_endpoint_conn.c:1420) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [TASK_MANAGER ]I: Subtask #0 ended (replicationtask_util.c:589) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [TASK_MANAGER ]I: Task - PX242JWPJG2JGAF43IIYQOJGLRH2JIPSGHIMGWQ is in STOPPED state, updating starting status to AR_NOT_APPLICABLE (repository.c:5102) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [TASK_MANAGER ]I: Updated Task, PX242JWPJG2JGAF43IIYQOJGLRH2JIPSGHIMGWQ, info with TaskState - 0 (replicationtask.c:3933) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [TASK_MANAGER ]I: Task management thread terminated (replicationtask.c:3956) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [METADATA_MANAGE ]I: Disconnecting Oracle database (oracle_endpoint_conn.c:1385) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [METADATA_MANAGE ]I: Disconnected Oracle database (oracle_endpoint_conn.c:1420) 2022-07-18T12:10:19.000+02:00 2022-07-18T10:10:19 [AT_GLOBAL ]I: Closing log file at Mon Jul 18 10:10:19 2022 (at_logger.c:2766) ```
1
answers
0
votes
50
views
profile picture
asked 3 months ago