AWS Glue job bookmarks and JDBC views

0

Hi all, I'd like to check if anyone has ever had any feedback from AWS regarding the current behavior of job bookmarks when you're sourcing from a database view. What the documentation explains (https://docs.aws.amazon.com/glue/latest/dg/monitor-continuations.html) is more related to actual tables. So, it is implied that since views don't actually have a primary key themselves, they are not tracked. That is exactly what happens, and for my current uses this is not a problem, it is what I intend to do because I'm using the database view data in the job as reference data. What I also wonder is if this can be changed in the near future.

asked 6 months ago302 views
1 Answer
0

You would have to specify the columns from the view that act as a bookmarkKeys (which is a good practice to do even for tables for visibility)

profile pictureAWS
EXPERT
answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions