Trying to Run a Job in Glue with Snowflake. Job Failed

0

2022-03-10 07:54:47,657 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): Exception in User Class: java.lang.reflect.UndeclaredThrowableException org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1862) org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:64) org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:188)

2022-03-10 07:54:47,652 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(91)): Exception in User Class java.lang.reflect.UndeclaredThrowableException

2022-03-10 07:54:47,651 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): InvocationTargetException java.lang.reflect.InvocationTargetException 2022-03-10 07:54:47,651 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): InvocationTargetException java.lang.reflect.InvocationTargetException

I am trying to run a job in Glue connecting to Snowflake. But getting error like this.

質問済み 2年前1119ビュー
1回答
0

Could you please clarify if you are using the Glue connector for Snowflake or if you have imported the Snowflake-Spark connector as additional library, as described in this blog post?

Also, some more details on the job itself and the configuration of the connector would be helpful.

The error snippet it is not of the more informative and I am not sure if some additional were hidden in the longer log.

You could try to use the new job insight logging that may simplify the troubleshooting.

hope this helps

AWS
エキスパート
回答済み 2年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ