Hi,
I was using AWS Glue job with Python shell. The log.info() messages does not log in the output log file instead it logs in the error.log file.
Here is the snippet we use to log messages in the glue job
we define logger as below code snippet:
def logger_setup(self):
self.logger = logging.getLogger(name)
self.logger.setLevel(logging.INFO)
formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
console_handler = logging.StreamHandler()
console_handler.setLevel(logging.INFO)
console_handler.setFormatter(formatter)
self.logger.addHandler(console_handler)
However when we used in the main file,
logger.info(f"first day of month for this job {self.first_day_of_month}")
This message logs in the Error logs instead Output logs. I want to post info messages in the Output logs. Can you tell me how we can achieve this? Is there any documentation available in logging messages in Glue job Python Shell
