How to see log of query made by Glue pyspark script against JDBC DB

0

Is there a way to see or log the SQL query made by glue DynamicFrame calls against a JDBC database source? We are trying to debug a long-running DynamicFrame Query and we are unable to see how the SQL call is being constructed. Would like to know what SQL query statement is being sent to the DB server

질문됨 2년 전456회 조회
1개 답변
0

Please try enabling the continuous logging feature for the glue job and see whether the required logs are visible or not. With the help of this feature, it is possible to view the real time logs in your Cloud watch console. Within these logs you can find executor logs, driver logs and spark job progress bar. I hope that these documentations might be of some help:

  1. https://docs.aws.amazon.com/glue/latest/dg/monitor-continuous-logging.html
  2. https://docs.aws.amazon.com/glue/latest/dg/monitor-profile-glue-job-cloudwatch-metrics.html
profile pictureAWS
지원 엔지니어
Chaitu
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠