Get inserted rows IDs in aws glue to use in child table

0

Hello. I have an aws glue that inserts data into a postgres table. Is it possible to have this same job fetch the db-generated IDs of the inserted rows and use them to insert data into a child table that has an FK to the first table's rows? or this has to be done ina different table?

已提問 9 個月前檢視次數 222 次
1 個回答
0
已接受的答案

You can but you would need a separate read and a join.
So you would insert into the table, then read the table with t he generated ids, then join with the child data and finally insert into the child table using the generated ids.

profile pictureAWS
專家
已回答 9 個月前
  • Thanks. I'm ok with having a separate read. But it doesn't seem the aws glue visual editor allows me to add child nodes to the data target "postgres" node in which I'm doing the first insertion. How would I achieve this?

  • Yes, that's a visual job limitation, you would need to either have two visual jobs in workflow or use a custom code node to write and read again (you could copy the code generated from the original sink/source)

  • Good advice. Thanks a lot

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南