using boto3 how can i set up an eventbridge to start a glue job when a crawler completes

0

I saw the sample implementation for scheduled event calling lambda function at https://github.com/awsdocs/aws-doc-sdk-examples/blob/main/python/example_code/lambda/scheduled_lambda.py

I need to invoke lambda function when a crawler completes using boto3.

thanks, Ravi.

asked a year ago339 views
1 Answer
0

In this case, you might be better off to use a Step Functions workflow. That will allow you to orchestrate running the crawler, then running the job (or whatever else you need to) after.

This blog post might help get you started: https://aws.amazon.com/blogs/compute/orchestrating-aws-glue-crawlers-using-aws-step-functions/

Sample code to go with it here: https://github.com/aws-samples/aws-stepfunctions-examples/tree/main/sam/demo-manage-glue-crawlers-with-step-functions

And if you want to run this whole thing on a schedule, you can do that using the Events property on the AWS::Serverless::StateMachine resource.

https://docs.aws.amazon.com/serverless-application-model/latest/developerguide/sam-resource-statemachine.html#sam-statemachine-events

AWS
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions