Glue ETL: Set output files to replaces existing files in source

0

Hello, I have recently had to move one of our Jobs from Glue DataBrew to Glue ETL - which is now up and running.

The issue I am having is that everytime the job runs it creates a new series of files. Can we set it so it overwrites the existing files in the S3 bucket source?

In Glue Databrew this option is in settings, "Replace output files for each job run" - but I cannot see it clearly in ETL, can anyone advise how to turn this on?

Thanks, Rob

已提问 8 个月前270 查看次数
1 回答
0
已接受的回答

I managed to achieve this by creating a Lifetime Cycle Rule in my S3 Bucket

已回答 8 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则