how to backup glue jobs on bitbucket repository

Question

Hello, as the title of the topic, I am writing this post to ask you help in order** to create a backup system of all the Glue jobs**, written in python, **on a bitbucket repository**.

In detail, I would like that, when a Glue jobs is updated , it is automatically uploaded on the bitbucket repository.

Resuming:

**1)** is it possible to export the Glue jobs?

**2) **if so, is it possible to find an automatic way?

Thank you in advance!

Answer

Since Glue job scripts are stored in an S3 bucket in your account, you may consider creating a similar CodePipeline-Glue workflow as suggested here - https://aws.amazon.com/blogs/devops/provision-codepipeline-glue-workflows/ which will help you to automate triggering and running Glue jobs. Then push the job code from S3 to bitbucket by establishing CodePipeline to bitbucket connection - https://docs.aws.amazon.com/codepipeline/latest/userguide/connections-bitbucket.html

how to backup glue jobs on bitbucket repository

Relevanter Inhalt