AWS DMS task is failing on source endpoint timeout
We are running DMS task which is ingesting from the on-prem mssql table with over 200mil records and has LOBs in it. Ingestion takes ~ 33 hours On-prem DB has a backup that happens after midnight and the task is failing right after that. Below are the logs:
[SOURCE_UNLOAD ]D: Network error encountered [SOURCE_UNLOAD ]D: Is connection error? TRUE [SOURCE_UNLOAD ]D: Endpoint is disconnected  (endpointshell.c:3807) [SOURCE_UNLOAD ]W: Error was encountered while FETCH-ing data from table ... [SOURCE_UNLOAD ]D: Error executing source loop 
I haven't tried the executeTimeout in the source endpoint connection attributes yet and wanted to ask what would be the suggested option to get around the timeout on the source issue
mostly this could be due to connections from dms are killed or timed out due to backup job. by itself backup command shouldnt disconnect the connection. it basically freezes other db connections for some time.I would suggest using executeTimeout on source endpoint connection attribute in seconds with a value greater than backup time. Being said that do set the remote query timeout to similar value by referring to https://docs.microsoft.com/en-us/sql/database-engine/configure-windows/configure-the-remote-query-timeout-server-configuration-option?view=sql-server-ver15#:~:text=Using%20SQL%20Server%20Management%20Studio,-To%20configure%20the&text=In%20Object%20Explorer%2C%20right%2Dclick,to%20wait%20before%20timing%20out.
Thank you for the answer. I have added executeTimeout to the source however it hasn't changed the behavior and the task failed again. I have noticed following in the debug logs: SOURCE_UNLOAD D: Setting connection timeout as : '8' (ar_odbc_conn.c:533) Not sure what setting is controlling this parameter. I haven't checked the source DB yet - passed it to the customer.
Migration task Progress is showing 0 and it is stuckasked 4 months ago
Can DMS do mapping that is not simply 1-1 from source to target?Accepted Answerasked 3 days ago
DMS - How to retain non-ASCII values when running DMS task from MySQL source to Redshift targetasked a month ago
DMS task stuck in starting for hoursasked a year ago
AWS DMS performance degradation until stopped and resumedasked 2 months ago
DMS Sync Issues with nullable column and new columnsasked 5 months ago
Do source filters speed up DMS from AWS RDS to S3?asked 5 months ago
AWS DMS task is failing on source endpoint timeoutasked a month ago
AWS DMS migration task doesn't automatically increment the source tableAccepted Answerasked 2 years ago
DMS task is creating full row duplicates in targetasked 3 months ago