By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Detect AutoMLJob completion in EventBridge

0

I'm using the Python SDK to create an AutoML experiment with boto3's create_auto_ml_job() function.

I want to be informed when the job finishes. I can see SageMaker events in EventBridge that fire when the individual training jobs finish (SageMaker Training Job State Change/SageMaker Processing Job State Change), but not when the controlling (AutoML) job finishes. Is there an event that fires for that? Am I missing something (a better way than eventbridge)?

Topics
Machine Learning & AIServerlessApplication Integration
Tags
Amazon SageMakerAmazon EventBridge
Language
English
Hobo
asked 3 months ago112 views
2 Answers
0

Hello.

I assume that you have set up S3 to store artifacts from AutoML jobs, but how about using an S3 event trigger to notify you when artifacts are stored in S3?
This setting allows you to be notified when an object is uploaded to S3.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventNotifications.html

profile picture
EXPERT
Riku_Kobayashi
answered 3 months ago
  • Hobo
    3 months ago

    Thanks Riku. That might work, but it seems a strange way to detect job completion. Isn't there anything more direct (like an actual event)? What if the job fails before producing any output?

0

Hi,

Did you try to capture the event emitted by Sagemaker for Processing job state change. See https://docs.aws.amazon.com/sagemaker/latest/dg/automating-sagemaker-with-eventbridge.html#processing-job-state

It is also very probably the one emitted by AutoML jobs when they complete.

Best,

Didier

profile pictureAWS
EXPERT
Didier_Durand
answered 3 months ago
  • Hobo
    3 months ago

    Hi Didier. Yes, I did. Unless I'm missing something, that event only seems to fire for the runs within an experiment (the processing and training jobs), not for the experiment itself (the controlling automl job). I'm pretty sure there are no sagemaker events that do what I need, but as I say, I might be missing something.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content