By using AWS re:Post, you agree to the Terms of Use

Glue job error : run ID: jr_f96799827354866ac2e798fb8b40d5781284e5ed5b3a4ff

0

When i try to run Glue job using python to Relationalize array and struct data...
Job run ID: jr_f96799827354866ac2e798fb8b40d5781284e5ed5b3a4ff519d6bced541913bc
I'm getting below error

INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.

Any one know the resolution for this issues

asked a year ago595 views
2 Answers
0

This is no error. The INFO flag already tells us that this is not an error and no need to worry about.

Edited by: paragshahade on Apr 29, 2021 7:02 AM

Edited by: paragshahade on Apr 29, 2021 7:03 AM

answered a year ago
0

Spark uses log4j for logging. To remove the INFO from the log, You can download logf4j-web-<version>.jar from apache (https://logging.apache.org/log4j/2.x/download.html) and upload the jar file to Amazon Simple Storage Service (Amazon S3), and use the jar file in the AWS Glue job.

To reference the Jar file from the S3 in the glue job, do the following:

  • Open the AWS Glue console.
  • In the navigation pane, choose Jobs.
  • Select the job - Drop down Actions, and then choose Edit job.
  • Expand the Security configuration, script libraries, and job parameters (optional) section.
  • In the Dependent jars path, paste the full S3 path where you stored the log4j-web jar file.
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions