Get inserted rows IDs in aws glue to use in child table

0

Hello. I have an aws glue that inserts data into a postgres table. Is it possible to have this same job fetch the db-generated IDs of the inserted rows and use them to insert data into a child table that has an FK to the first table's rows? or this has to be done ina different table?

gefragt vor 9 Monaten222 Aufrufe
1 Antwort
0
Akzeptierte Antwort

You can but you would need a separate read and a join.
So you would insert into the table, then read the table with t he generated ids, then join with the child data and finally insert into the child table using the generated ids.

profile pictureAWS
EXPERTE
beantwortet vor 9 Monaten
  • Thanks. I'm ok with having a separate read. But it doesn't seem the aws glue visual editor allows me to add child nodes to the data target "postgres" node in which I'm doing the first insertion. How would I achieve this?

  • Yes, that's a visual job limitation, you would need to either have two visual jobs in workflow or use a custom code node to write and read again (you could copy the code generated from the original sink/source)

  • Good advice. Thanks a lot

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen