1 Answer
- Newest
- Most votes
- Most comments
0
In this case, you might be better off to use a Step Functions workflow. That will allow you to orchestrate running the crawler, then running the job (or whatever else you need to) after.
This blog post might help get you started: https://aws.amazon.com/blogs/compute/orchestrating-aws-glue-crawlers-using-aws-step-functions/
Sample code to go with it here: https://github.com/aws-samples/aws-stepfunctions-examples/tree/main/sam/demo-manage-glue-crawlers-with-step-functions
And if you want to run this whole thing on a schedule, you can do that using the Events property on the AWS::Serverless::StateMachine
resource.
answered a year ago
Relevant content
- asked 8 months ago
- asked 5 months ago
- Accepted Answerasked 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- How can I use a Lambda function to automatically start an AWS Glue job when a crawler run completes?AWS OFFICIALUpdated 2 years ago