Overwrite content in Redshift using Glue

0

I have a customer who wants to overwrite a table in Redshift in a Glue job.

After looking, there does not seem to be a mode=overwrite option in Glue DynamicFrameWriter at the moment.

What workarounds could the customer use for this?

EXPERTO
preguntada hace 6 años1700 visualizaciones
1 Respuesta
0
Respuesta aceptada

If you mean upsert, there is a workaround solution, have glue insert all rows into a staging table and then perform a upsert/merge outside of glue.

Use a Staging Table to Perform a Merge (Upsert), https://docs.aws.amazon.com/redshift/latest/dg/c_best-practices-upsert.html

There is also a big data blog talking about upsert into Amazon Redshift using AWS Glue and SneaQL, I haven't tried, however, sounds cool to give a go. https://aws.amazon.com/blogs/big-data/upsert-into-amazon-redshift-using-aws-glue-and-sneaql/

MODERADOR
respondido hace 6 años
profile picture
EXPERTO
revisado hace 10 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas