How to manage transaction in AWS glue job

Question

Is it possible to manage transaction operations like commit and rollback in AWS glue job.

Answer

1. AWS Glue uses `job.init` & `job.commit` to track already processed data using job bookmarks. To learn more about these APIs, please refer to [Using Job Bookmarks with the AWS Glue Generated Script](https://docs.aws.amazon.com/glue/latest/dg/monitor-continuations.html#monitor-continuations-script).
2. If you are looking for information on performing transactions on governed tables, you can do so from Glue ETL jobs. To learn more about it, please refer to [Reading from and Writing to the Data Lake Within Transactions](https://docs.aws.amazon.com/lake-formation/latest/dg/transaction-ops.html).

How to manage transaction in AWS glue job

Contenuto pertinente