how to extend the total processing time for Asynchronous endpoint upto 60 minutes?

1

I'm facing the below error when asynchronous endpoint is invoked in sagemaker for batch processing:

"Your invocation timed out while waiting for a response from container primary. Review the latency metrics for each container in Amazon CloudWatch, resolve the issue, and try again."

I found that the issue is due to the total processing time exceeds the default 15min window.

So, I would like to know how to extend the total processing time for Asynchronous endpoint upto 60 minutes as mentioned in aws docs: https://docs.aws.amazon.com/sagemaker/latest/dg/async-inference.html

Thank you.

Sampath
asked a year ago230 views
1 Answer
0
Accepted Answer

Hi, I found the solution to extend the total processing time for Asynchronous endpoint upto 60 minutes. Use this parameter "InvocationTimeoutSeconds=3600" when invoking the async endpoint.

code looks like below:

response = sm_client.invoke_endpoint_async(
EndpointName=endpoint_name,
InputLocation=input_file_s3_path,
ContentType='text/csv',
Accept='application/json',
InvocationTimeoutSeconds=3600    
)

Thank you.

Sampath
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions