Glue Job --extra-jars parameter is not persisted

0

I need to pass some extra jars to an existing Glue Job. Following the docs I have uploaded the jar to an s3 bucket and I have added the --extra-jars parameter. --extra-jars -> s3://....

I save the job and when I reload the page the config is not there anymore. If I run the job the parameter is not passed to the job !!!!

Is this a bug? Someone had the same issue? Am I doing something wrong?

profile picture
已提問 8 個月前檢視次數 712 次
2 個答案
0

Some parameters have their own visual component, in this case when you reload it should detect the parameter and display that config as a text box "Dependent JARs path" under the advanced options.

profile pictureAWS
專家
已回答 8 個月前
  • I will check that but at the end of the day, the jar is not loaded.

  • "Dependent JARs path" is not filled by the --extra-jars parameter. Looks like a bug to me. It actually works the other way around. If you add a path in "Dependent JARs path" the --extra-jars param is filled and passed to the job run. If this is the way it is intended to work the docs should be updated accordingly.

0

Using Dependent JARs path works and populate the --extra-jars parameters. Directly adding the s3 path to the --extra-jars param is not persisted.

profile picture
已回答 8 個月前
  • I see, must be an UI limitation, it does work fine when you create the job using other ways

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南