Custom script cannot be saved in Glue
0
I am trying to combined 2 sources and added repartition(1) for a single output file in csv, the script worked until today and when I go back to check the script, it seems like Glue deleted repartition(1) part and connected automatically from Union. I added the repartition code back in and saved, but it still can't be save and resulting with 2 outputs instead of 1. Same thing happening when I try to create a new glue job.
asked 2 months ago31 views
1 Answers
0
I think it's a bug. I checked the script versions on S3 and it seems that the edited script is being saved, but then immediately overwritten by the original (generated) script. I'm uploading the script to S3 directly via aws cli as a workaround.
answered 2 months ago
Relevant questions
Not able to create truststorePassword with amazon provided script
asked 2 days agoAWS Glue RDS to single file CSV
asked 5 months agoHow can I create a global variable in Script Canvas? [Lumberyard 1.14]
Accepted Answerasked 4 years agoCustom script cannot be saved in Glue
asked 2 months agoConnect to RDS postgres database in GLUE script
asked 3 months agoAWS glue combining multiple input into a single output csv
asked 5 months agomost cost effective way to use a bash script to update a csv file
asked 4 days agoAWS Glue crawler detecting a .(dot) before header of a csv file
asked 3 years agopost_install, post_install_args and script output logs ?
asked 3 years agoGlue Studio Job - How to add the file name or path as a Source Key output or partition
Accepted Answerasked 3 months ago