By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Get inserted rows IDs in aws glue to use in child table

0

Hello. I have an aws glue that inserts data into a postgres table. Is it possible to have this same job fetch the db-generated IDs of the inserted rows and use them to insert data into a child table that has an FK to the first table's rows? or this has to be done ina different table?

Topics
DatabaseAnalytics
Tags
DatabaseAWS Glue
Language
English
Sary Al-Assad
asked 8 months ago210 views
1 Answer
0
Accepted Answer

You can but you would need a separate read and a join.
So you would insert into the table, then read the table with t he generated ids, then join with the child data and finally insert into the child table using the generated ids.

profile pictureAWS
EXPERT
Gonzalo Herreros
answered 8 months ago
  • Sary Al-Assad
    8 months ago

    Thanks. I'm ok with having a separate read. But it doesn't seem the aws glue visual editor allows me to add child nodes to the data target "postgres" node in which I'm doing the first insertion. How would I achieve this?

  • Gonzalo Herreros EXPERT
    8 months ago

    Yes, that's a visual job limitation, you would need to either have two visual jobs in workflow or use a custom code node to write and read again (you could copy the code generated from the original sink/source)

  • Sary Al-Assad
    8 months ago

    Good advice. Thanks a lot

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content