By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

How to change the glue job bookmark manually?

0

Hi everyone, I changed the KMS key in Glue Catalog setting. So I need to delete my tables, and then re-create them by running Crawlers. it seems that deleting and recreating tables causes the bookmark of ETL jobs is reset. So, is there any way to configure bookmark manually? I mean configuring it so that it doesn’t scan all the data given new table. thanks

Topics
Analytics
Tags
AWS Glue
Language
English
profile picture
gh02
asked 10 months ago247 views
1 Answer
0
Accepted Answer

I could not find any solution for config the bookmark manually, but there is a way to skip scanning all the data by comment out the processing steps: https://stackoverflow.com/questions/67680439/manually-setting-aws-glue-etl-bookmark

profile picture
gh02
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content