AWS Glue ETL Automation

0

Our current setup involves AWS Glue in operation, where data is being extracted from one SQL Server and loaded into another SQL Server through use of AWS Glue Studio for selected tables.

Is there a way to configure AWS Glue to monitor changes in source table columns while maintaining the existing data transfer process, and additionally, update the table columns in the destination SQL Server before transferring the data? How would we automate this?

bluesky
質問済み 8ヶ月前178ビュー
1回答
0

This is possible but you would have to use the script side of glue.

For example I’ve written a Python script to move data between servers mssql and Postgres. You would have to develop a script that compared the schemas between 2 database and update accordingly.

profile picture
エキスパート
回答済み 8ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ