how do we version control an aws glue workflow?

Question

how do we version control an aws glue workflow ?

Answer

Hi,

You can use a source control tool (e.g., AWS CodeCommit) for checking in and versioning your AWS Glue ETL source code and AWS Glue Workflow CloudFormation template files. Refer the following two blogs which provide more details regarding the same...

1. Using AWS DevOps Tools to model and provision AWS Glue workflows
https://aws.amazon.com/blogs/devops/provision-codepipeline-glue-workflows/

2. Implement continuous integration and delivery of serverless AWS Glue ETL applications using AWS Developer Tools
https://aws.amazon.com/blogs/big-data/implement-continuous-integration-and-delivery-of-serverless-aws-glue-etl-applications-using-aws-developer-tools/

Hope this helps!

how do we version control an aws glue workflow?

Relevant questions

How do you update packages on AWS Glue?

Passing parameters to the Glue Workflow using Python

Glue WorkFlow - Max concurrent runs exceeded

Can Glue bookmarks be used between Glue workflow steps?

Development Endpoint & Glue Version 1.0

One glue job for multiple workflows

How to pass parameters from an event rule through a glue workflow trigger to a job

How to create a Glue Workflow programmatically?

how do we version control an aws glue workflow?

Activity workflow threw ActivityTaskTimedOut but process is still running