Unable to Connect api gateway with sagemaker endpoint

Question

i have created a personal studio in sagemaker and deployed my custom fastapi code using docker and on sgemaker studio UI I'm able to test the invocation but while trying with AWS apigateway its giving 404 with

and when trying with boot 3

import boto3

import json
client = boto3.client('sagemaker-runtime')
payload = {
  "session_id": "ccccccccccc",
  "user_name": "mfxxxx@gmail.com",
  "analytical_query": "something "
}

endpoint_name = 'Insight-xxxxx-Endpoint-2024xxx-05xxxx'
content_type = 'application/json'
payload = json.dumps(payload)
response = client.invoke_endpoint(
    EndpointName=endpoint_name,
    ContentType=content_type,
    Body=payload
)

botocore.errorfactory.ValidationError: An error occurred (ValidationError) when calling the InvokeEndpoint operation: Inference Component Name header is required for endpoints to which you plan to deploy inference components. Please include Inference Component Name header or consider using SageMaker models.

lavaraja-padala · Answer

Hello Hope you are doing well.

From the error code that you have shared, it seems that you created endpoint using Sagemaker [inference component feature](https://aws.amazon.com/blogs/aws/amazon-sagemaker-adds-new-inference-capabilities-to-help-reduce-foundation-model-deployment-costs-and-latency/). If that was the case, please include the `InferenceComponentName` in the `invoke_endpoint` call to invoke the endpoint.

https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/sagemaker-runtime/client/invoke_endpoint.html#:~:text=InferenceComponentName%3D%27string%27

lavaraja-padala · Answer

Hello,

Thank you for confirming that you did not have inference component associated. Can you please share the steps you followed to create the endpoint? Please mask the information wherever applicable before sharing.

And regarding Sagemaker endpoint invocation using API gateway, you might refer below example blog.

https://aws.amazon.com/blogs/machine-learning/creating-a-machine-learning-powered-rest-api-with-amazon-api-gateway-mapping-templates-and-amazon-sagemaker/

Unable to Connect api gateway with sagemaker endpoint

Relevant content