I'm running many Glue jobs. How can we set the limit or alarm if jobs runs more than 6 hours or 10DPU hours

Question

I'm running many Glue jobs. How can we set the limit or alarm if jobs runs more than 6 hours or 10DPU hours. Is there any Cloudwatch metrics available on which alarm can be set for cost monitoring purpose.

Answer

Look at this [doc](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) that has details on how to set max workers (DPUs) and timeout for a job. You can also use [cloudwatch events](https://docs.aws.amazon.com/glue/latest/dg/automating-awsglue-with-cloudwatch-events.html) to take action on when state of the job changes.

I'm running many Glue jobs. How can we set the limit or alarm if jobs runs more than 6 hours or 10DPU hours

Contenuto pertinente