Using DMS not able to add column transformation for existing tables in redshift

0

I have created an DMS service with sources as MySQL and endpoint as redshift , so i created an DMS task to add datetime and update operations columns for my existing table in redshift which is not being happening.Is it possible to add columns to my renamed tables in redshift?

  • below is my dms task , where i'm trying to add column to renamed table testing_dms_scd_status which is in redshift which i'm not able to do , can i know the reason or solution for it? { "rules": [ { "rule-type": "transformation", "rule-id": "435175087", "rule-name": "435175087", "rule-target": "schema", "object-locator": { "schema-name": "GOAUDITS" }, "parallel-load": null, "rule-action": "rename", "value": "public", "old-value": null }, { "rule-type": "selection", "rule-id": "425505670", "rule-name": "425505670", "object-locator": { "schema-name": "GOAUDITS", "table-name": "GA_SCD_STATUS_MT" }, "rule-action": "include", "filters": [] }, { "rule-type": "transformation", "rule-id": "425491926", "rule-name": "425491926", "rule-target": "table", "object-locator": { "schema-name": "GOAUDITS", "table-name": "GA_SCD_STATUS_MT" }, "parallel-load": null, "rule-action": "rename", "value": "testing_dms_scd_status", "old-value": null } ] }

asked 13 days ago220 views
2 Answers
0

Yes it is possible but I do not see any column transformation rule in what you have shared. Can you refer https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.TableMapping.SelectionTransformation.Expressions.html and check for add-column rule action.

Also consider if you can leverage DEFAULT value for table columns if you want something like insert date time column on table. This can make it easier on DMS.

profile pictureAWS
answered 12 days ago
profile picture
EXPERT
reviewed 12 days ago
0

Below is my transformation rule and to add columns to renamed tables in redshift with name GA_SCD_STATUS_MT doesn't work , so my requirement is it achievable?

{ "rules": [ { "rule-type": "transformation", "rule-id": "137766153", "rule-name": "137766153", "rule-target": "column", "object-locator": { "schema-name": "GOAUDITS", "table-name": "GA_SCD_STATUS_MT" }, "parallel-load": null, "rule-action": "add-column", "value": "DMS_UPDATED_AT", "old-value": null, "expression": "current_timestamp", "data-type": { "type": "datetime" } }, { "rule-type": "transformation", "rule-id": "2", "rule-name": "2", "rule-target": "column", "object-locator": { "schema-name": "GOAUDITS", "table-name": "GA_SCD_STATUS_MT" }, "rule-action": "add-column", "value": "DMS_OPS", "expression": "operation_indicator('D', 'U', 'I')", "data-type": { "type": "string", "length": 50 } }, { "rule-type": "selection", "rule-id": "137734000", "rule-name": "137734000", "object-locator": { "schema-name": "GOAUDITS", "table-name": "GA_SCD_STATUS_MT" }, "rule-action": "include", "filters": [], "parallel-load": null, "isAutoSegmentationChecked": false } ] }

answered 9 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions