how to backup glue jobs on bitbucket repository
Hello, as the title of the topic, I am writing this post to ask you help in order to create a backup system of all the Glue jobs, written in python, on a bitbucket repository.
In detail, I would like that, when a Glue jobs is updated , it is automatically uploaded on the bitbucket repository.
Resuming:
1) is it possible to export the Glue jobs?
2) if so, is it possible to find an automatic way?
Thank you in advance!
Since Glue job scripts are stored in an S3 bucket in your account, you may consider creating a similar CodePipeline-Glue workflow as suggested here - https://aws.amazon.com/blogs/devops/provision-codepipeline-glue-workflows/ which will help you to automate triggering and running Glue jobs. Then push the job code from S3 to bitbucket by establishing CodePipeline to bitbucket connection - https://docs.aws.amazon.com/codepipeline/latest/userguide/connections-bitbucket.html
Relevant questions
AWS Backup events
asked 3 months agoWhat are the benefits when I run a Glue job inside VPC?
Accepted Answerasked a month agoHow is the function create_partition_index called in Glue Jobs?
Accepted Answerasked 3 months ago"Resource Unavailable" in AWS Glue
Accepted AnswerSend efs backup to S3
Accepted Answerasked 5 months agoSophisticated Triggering of Glue Jobs
asked 20 days agohow to backup glue jobs on bitbucket repository
asked 3 months agoGlue slow on JSON to Parquet
asked 3 months agoAWS Glue - Glue Jobs - Glue 2.0: Worker Types
asked 2 months agoGlue Jobs & Multiple tables
Accepted Answerasked 4 years ago