how to extend the total processing time for Asynchronous endpoint upto 60 minutes?

Question

I'm facing the below error when asynchronous endpoint is invoked in sagemaker for batch processing:

```
"Your invocation timed out while waiting for a response from container primary. Review the latency metrics for each container in Amazon CloudWatch, resolve the issue, and try again."
```
I found that the issue is due to the total processing time exceeds the default 15min window.

So, I would like to know how to extend the total processing time for Asynchronous endpoint upto 60 minutes as mentioned in aws docs: [https://docs.aws.amazon.com/sagemaker/latest/dg/async-inference.html]()

Thank you.

Sampath · Accepted Answer

Hi, I found the solution to extend the total processing time for Asynchronous endpoint upto 60 minutes. 
Use this parameter "InvocationTimeoutSeconds=3600" when invoking the async endpoint.

code looks like below:

```
response = sm_client.invoke_endpoint_async(
EndpointName=endpoint_name,
InputLocation=input_file_s3_path,
ContentType='text/csv',
Accept='application/json',
InvocationTimeoutSeconds=3600    
)
```
Thank you.

how to extend the total processing time for Asynchronous endpoint upto 60 minutes?

Aggiungi la tua risposta

Contenuto pertinente