Glue job Last modified datetime
Hello, In the Glue job Dashboard we noticed that the "Last Modified" column has been updated for nearly all the jobs. We did not have a deployment or otherwise change the jobs. We're trying to understand in what cases the Last modified column is updated.
Is it possible that it was an AWS glue software update or is this only modified from the customer side?
- Newest
- Most votes
- Most comments
Hello,
In order to answer your question, as well as to assist with investigating the root cause of this behavior, we require details that are non-public information, which will allow for further investigation.
As such, may I please request that you open a support case with AWS using the following link
Hi Sid.
Would prefer not to open a support ticket. There can't be that many reasons this field is updated and I wonder if you have access to the source code to see what are the different reasons this might be updated. It isn't correlated to our job updates. We do this thru terraform and our deployment dates don't line up with this time. And, it doesnt line up with execution times because hundreds of jobs are modified at the same time. I suspect some kind of update/scan process on the AWS side, maybe a security check that is updating the timestamp after scan
Relevant content
- asked 8 months ago
- asked 6 months ago
AWS OFFICIALUpdated 3 years ago- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
Never seen that, maybe check in CloudTrail if it says what updated those jobs but either is a process you have or a bug. Do you get the same timestamps when checking in the AWS CLI?
Yep, getting the same in the CLI when I use 'aws glue get-job'. I looked at more jobs and it looks like not all jobs are updated, but they are updated in batches. The oldest date is 8/18/2023. The times are not matching job run times or deployment times, but there definitely looks to be a pattern where hundreds of jobs are having the last modified time updated with a difference of seconds (like they were queued).