Skip to content

How to generate equivalent code to AWS Glue Connector for existing connections created using AWS Console for Glue

0

There are multiple AWS Glue connections (also termed as Data Catalog Connection or Data Connections) created using AWS Glue Studio for different data sources. How can I generate the equivalent code for all of them for versioning and/or to recreate the connection easily in case of an accidental deletion of the connection?

asked 2 years ago206 views

2 Answers
0

Hello.

By managing your code with a code version control system such as GitHub, you can quickly restore settings even if you accidentally delete them.
Since AWS Glue Studio can be integrated with GitHub, I thought it would be a good idea to create a template-like code and edit it for each Glue connection.
https://docs.aws.amazon.com/glue/latest/dg/edit-job-add-source-control-integration.html

EXPERT

answered 2 years ago

  • Thanks Riku! It is true that we can version control the AWS Glue job scripts and I am using this feature. The Glue scripts hold the Glue connection name, however not the Glue data connection properties, and this information is not being stored in the version control. In case if the Glue connection was removed or modified, I do not see a way to retrieve it back yet and is why I was raising this question.

0

Hi As answered above you can store you connector code with any source control tools like Github or Bitbucket. On top of that, you can integrate it with CDK, so deployment of your code will be automated

answered 2 years ago

  • I could see how to integrate the Glue job with source control, however, I do not see an option for the Glue connector code to direct to repository. If there is a way, please guide me how to do the same. Also details on how to integrate with CDK for code deployment. Thanks for trying to help me on this!

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.