Hello, According to the description, I assume you are going to use the Sagemaker notebooks for the development of the inference code and then export the code as a script.
If you model is light weight, you can cache the model inside you server application and call the predictions in it.
model = load_model() @anvil.server.callable def function(foo): return model.predict("")
Alternatively you can create a SageMaker endpoint and inside the same function above you can call the Sagemaker endpoint and pass it back to the client as a response to the web-socket invocation.
Deploying web application to aws greengrassasked a month ago
Is it possible to deploy a small HTTPS web app on Fargate, internet accessible, without using a load balancer?asked 6 months ago
Is the AWS Pinpoint SDK intended to only be used by a mobile app (iOS/Android) or a web client?asked a year ago
Using HuggingFace in Sagemaker Studio as part of a projectasked 2 months ago
Using same authentication with cognito and amazon connect in a app-webasked 5 months ago
I wanted to launch a new update to my web app I ended up changing the operating system on my EC2asked 9 days ago
Using SageMaker as a backend for a web appasked 10 months ago
Architecture help - How can I architect a web app with a custom subdomain and it's own configuration for each customer?asked 7 months ago
How to give users a limited access time to a web app running on ECS/EC2asked 7 months ago
How to pass the Amplify app ID to a function? How to do app introspection from backend functions?Accepted Answerasked 7 months ago