Overwrite content in Redshift using Glue

0

I have a customer who wants to overwrite a table in Redshift in a Glue job.

After looking, there does not seem to be a mode=overwrite option in Glue DynamicFrameWriter at the moment.

What workarounds could the customer use for this?

전문가
질문됨 6년 전1698회 조회
1개 답변
0
수락된 답변

If you mean upsert, there is a workaround solution, have glue insert all rows into a staging table and then perform a upsert/merge outside of glue.

Use a Staging Table to Perform a Merge (Upsert), https://docs.aws.amazon.com/redshift/latest/dg/c_best-practices-upsert.html

There is also a big data blog talking about upsert into Amazon Redshift using AWS Glue and SneaQL, I haven't tried, however, sounds cool to give a go. https://aws.amazon.com/blogs/big-data/upsert-into-amazon-redshift-using-aws-glue-and-sneaql/

중재자
답변함 6년 전
profile picture
전문가
검토됨 10달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠