2 réponses
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
My contact at AWS suggested to open a ticket and post the issue in re:Post. Case ID: 10433082981 I just shared the spark UI logs in the ticket. I can share the log on demand in private messages. Alain
répondu il y a 2 ans
0
Hello Alain,
I understand that you have enabled auto scaling for the Glue job, but from the CloudWatch metrics it seems like it has not scaled down the executors throughout the job. To further investigate this issue, we would require the Spark History Server logs and the job run. For more information, see Enabling the Apache Spark web UI for AWS Glue jobs.
Please, feel free to open a support case with AWS using the following link with the Spark History Server logs, the job run and we would be happy to help.
Contenus pertinents
- demandé il y a un an
- demandé il y a 2 mois
- demandé il y a un an
- AWS OFFICIELA mis à jour il y a 2 ans
Hello Alain,
I checked the case ID shared by you and can see that you have shared the logs. We will get back to you on the same case ID. If you have any additional queries regarding this please feel free to get back to me. Thanks for your patience and understanding on the case.