Sagemaker Processing Job does not terminate itself

0

Hello,

I am trying to do some simple preprocessing to my data, to be specific, I am trying to split my data into train, test and validation set. I want to make use of the processing job feature and have written a script for it.

However, when I executed the code to create a processor and run it, it says it is creating the processing script and continues running for more than 20mins, even though I only have 1400 examples in my dataset. I had to manually stop it and when I check the cloud logs, the last line of the preprocessing script is already executed, meaning the script ran properly and completely. The output can also be found in the s3 bucket. So my question is, why my processing job is not terminated automatically?

Andy
已提问 25 天前81 查看次数
1 回答
0

Please find the below document for reference - default of 86400 seconds (1 day) and the maximum value is 777600 (9 days). https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_ProcessingStoppingCondition.html#sagemaker-Type-ProcessingStoppingCondition-MaxRuntimeInSeconds

profile pictureAWS
已回答 23 天前
  • Hi, thanks a lot for the input. One thing that is still confusing to me is, why doesn't the processing job end itself after it executed my script completely? Is it necessary that we always set the maximum timeout time for the job?

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则