Step Function freezes

0

I have noticed that my AWS Step Function freezes after previous run has been aborted with some jobs still left in the pending state. The use case: I have a step function that increments through the files in S3 bucket (using Map for that) and then performs data masking on the files where required (using DataBrew) and then copies files to another s3 bucket. After the test run, if I notice the error in the flow, I stop the run and then using the script stop all the running jobs in the Running state. As the result of this, some jobs remain in the pending state and since the top level run has been stopped they persist there. After fixing the flow and triggering the new run of the function, I have noticed that it starts but I can't see any jobs appering in the pending/Running etc. state. I stopped the run after 5min or so and re-tried again in an hour but the same behaviour persisted. After I ran the job next day the job ran fine however after stopping the job with pending tasks and then trying to start the freeze happened again.

No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions