Send customised notification of Glue job using SNS
I need to send notification having ** job execution time**, number of records processed and the rest of the things using SNS. Below is the template I am using, but I need these two inputs too in my notification: { "detail-type": ["Glue Job State Change"], "source": ["aws.glue"], "detail": { "jobName": ["job_name1","job_name2"], "severity": ["ERROR"], "state": ["FAILED", "ERROR", "TIMEOUT", "STOPPED"] } } Can you please help me.
Hi ,
the 2 additional inputs (job execution time, number of records processed) you require are not generated automatically by Glue.
The job execution time you can retrieve it using the Glue APIs get_job_run passing the latest run_id.
The number of record preprocessed you would need to calculate it in the job and then export it in and external file or db table you can query to retrieve it and add it to the SNS message before you send it.
hope this helps.
Relevant questions
I want to send a notification to discord when amplify's app is deployed.
asked 5 months agoSend customised notification of Glue job using SNS
asked 4 months agoSNS send same push notification to millions of user synchronously
asked a month agoAWS SES not sending notification via SNS
Accepted Answerasked 5 months agoSend notification upon SQL failure
asked 5 months agoAWS SNS - Unable to send SMS
asked 7 days agosend email from glue job
Accepted Answerasked 5 months agoNeed AWS Glue to store bad records/ records with error when reading Mongo db data to a S3 path and process the rest of the data.
asked 2 months agoCreate a notification once CloudFormation StackSet is finished
asked 5 months agoWhy is my SMS received from SNS having a different font?
asked 5 months ago
Hi, thanks for the response. How do I use the API and the querying file/table part, should I use a Lambda function for this?