Trying to Run a Job in Glue with Snowflake. Job Failed

Question

2022-03-10 07:54:47,657 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): Exception in User Class: java.lang.reflect.UndeclaredThrowableException
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1862)
org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:64)
org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:188)

2022-03-10 07:54:47,652 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(91)): Exception in User Class
java.lang.reflect.UndeclaredThrowableException

2022-03-10 07:54:47,651 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): InvocationTargetException java.lang.reflect.InvocationTargetException
2022-03-10 07:54:47,651 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(70)): InvocationTargetException java.lang.reflect.InvocationTargetException

I am trying to run a job in Glue connecting to Snowflake. But getting error like this.

Answer

Could you please clarify if you are using the Glue connector for Snowflake or if you have imported the Snowflake-Spark connector as additional library, as described [in this blog post](https://aws.amazon.com/blogs/big-data/performing-data-transformations-using-snowflake-and-aws-glue/)?

Also, some more details on the job itself and the configuration of the connector would be helpful.

The error snippet it is not of the more informative and I am not sure if some additional were hidden in the longer log.

You could try to use the new [job insight logging](https://docs.aws.amazon.com/glue/latest/dg/monitor-job-insights.html) that may simplify the troubleshooting.

hope this helps

Trying to Run a Job in Glue with Snowflake. Job Failed

相关内容