1 Answer
- Newest
- Most votes
- Most comments
0
Not out of the box at this time, the way to do it is a custom code node that writes into a Postgres temporary table and then issue a SQL command to do the upsert/merge into the final table (using JDBC, the psycopg2 library or similar).
Relevant content
- asked 2 years ago
- asked 4 months ago
AWS OFFICIALUpdated 3 years ago- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
can we use 'Custom Transform' to make it? or do i have use in seperate to do it?
Yes you can, despite the name "transform" you can put any code, including writing
sorry sir, i'm new at here. I think I get your idea, but I want to confirm a few things. This means that after I perform transformations on my data, I have to create a script to perform an upsert query into my table. My next question is whether I can set the connection/target table directly from the script? this is a simple flow image that I have created, and I want to make sure that we line up this 'custom transform' can be used for the script code requirements above.
https://ibb.co/C64kp2q
Your custom transform node has to be part of the graph, it should be the last node and you do the writing/updating there. That's it