By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

AWS Glue ETL Automation

0

Our current setup involves AWS Glue in operation, where data is being extracted from one SQL Server and loaded into another SQL Server through use of AWS Glue Studio for selected tables.

Is there a way to configure AWS Glue to monitor changes in source table columns while maintaining the existing data transfer process, and additionally, update the table columns in the destination SQL Server before transferring the data? How would we automate this?

Topics
AnalyticsDatabase
Tags
AnalyticsDatabaseAWS GlueExtract Transform & Load Data
Language
English
bluesky
asked 7 months ago170 views
1 Answer
0

This is possible but you would have to use the script side of glue.

For example I’ve written a Python script to move data between servers mssql and Postgres. You would have to develop a script that compared the schemas between 2 database and update accordingly.

profile picture
EXPERT
Gary Mclean
answered 7 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content