By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Custom script cannot be saved in Glue

0

I am trying to combined 2 sources and added repartition(1) for a single output file in csv, the script worked until today and when I go back to check the script, it seems like Glue deleted repartition(1) part and connected automatically from Union. I added the repartition code back in and saved, but it still can't be save and resulting with 2 outputs instead of 1. Same thing happening when I try to create a new glue job.

Topics
Analytics
Tags
AWS Glue
Language
English
AWS-User-5987035
asked 2 years ago668 views
1 Answer
0

I think it's a bug. I checked the script versions on S3 and it seems that the edited script is being saved, but then immediately overwritten by the original (generated) script. I'm uploading the script to S3 directly via aws cli as a workaround.

Juraj Misur
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content