Get inserted rows IDs in aws glue to use in child table

0

Hello. I have an aws glue that inserts data into a postgres table. Is it possible to have this same job fetch the db-generated IDs of the inserted rows and use them to insert data into a child table that has an FK to the first table's rows? or this has to be done ina different table?

posta 9 mesi fa222 visualizzazioni
1 Risposta
0
Risposta accettata

You can but you would need a separate read and a join.
So you would insert into the table, then read the table with t he generated ids, then join with the child data and finally insert into the child table using the generated ids.

profile pictureAWS
ESPERTO
con risposta 9 mesi fa
  • Thanks. I'm ok with having a separate read. But it doesn't seem the aws glue visual editor allows me to add child nodes to the data target "postgres" node in which I'm doing the first insertion. How would I achieve this?

  • Yes, that's a visual job limitation, you would need to either have two visual jobs in workflow or use a custom code node to write and read again (you could copy the code generated from the original sink/source)

  • Good advice. Thanks a lot

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande