2 Antworten
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
My contact at AWS suggested to open a ticket and post the issue in re:Post. Case ID: 10433082981 I just shared the spark UI logs in the ticket. I can share the log on demand in private messages. Alain
beantwortet vor 2 Jahren
0
Hello Alain,
I understand that you have enabled auto scaling for the Glue job, but from the CloudWatch metrics it seems like it has not scaled down the executors throughout the job. To further investigate this issue, we would require the Spark History Server logs and the job run. For more information, see Enabling the Apache Spark web UI for AWS Glue jobs.
Please, feel free to open a support case with AWS using the following link with the Spark History Server logs, the job run and we would be happy to help.
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 2 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr
Hello Alain,
I checked the case ID shared by you and can see that you have shared the logs. We will get back to you on the same case ID. If you have any additional queries regarding this please feel free to get back to me. Thanks for your patience and understanding on the case.