AWS Glue ETL Automation

Our current setup involves AWS Glue in operation, where data is being extracted from one SQL Server and loaded into another SQL Server through use of AWS Glue Studio for selected tables.

Is there a way to configure AWS Glue to monitor changes in source table columns while maintaining the existing data transfer process, and additionally, update the table columns in the destination SQL Server before transferring the data? How would we automate this?

주제

분석 데이터베이스

태그

분석 데이터베이스 AWS Glue 데이터 추출, 변환 및 로드

언어

English

bluesky

질문됨 8달 전177회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

This is possible but you would have to use the script side of glue.

For example I’ve written a Python script to move data between servers mssql and Postgres. You would have to develop a script that compared the schemas between 2 database and update accordingly.

전문가

Gary Mclean

답변함 8달 전

AWS Glue ETL Automation

관련 콘텐츠