Trying to Run a Job in Glue with Snowflake. Job Failed

0

2022-03-10 07:54:47,657 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): Exception in User Class: java.lang.reflect.UndeclaredThrowableException org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1862) org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:64) org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:188)

2022-03-10 07:54:47,652 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(91)): Exception in User Class java.lang.reflect.UndeclaredThrowableException

2022-03-10 07:54:47,651 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): InvocationTargetException java.lang.reflect.InvocationTargetException 2022-03-10 07:54:47,651 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): InvocationTargetException java.lang.reflect.InvocationTargetException

I am trying to run a job in Glue connecting to Snowflake. But getting error like this.

asked 9 months ago518 views
1 Answer
0

Could you please clarify if you are using the Glue connector for Snowflake or if you have imported the Snowflake-Spark connector as additional library, as described in this blog post?

Also, some more details on the job itself and the configuration of the connector would be helpful.

The error snippet it is not of the more informative and I am not sure if some additional were hidden in the longer log.

You could try to use the new job insight logging that may simplify the troubleshooting.

hope this helps

EXPERT
answered 9 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions