MLOps/LLMOps solution on AWS?

0

What AWS service is relevant for MLOps/LLMOps? What do we use for logging, monitoring, model performance, versioning for ML models on AWS cloud? Is this built into SageMaker?

asked 3 months ago634 views
2 Answers
0

Yes, SageMaker and BedRock are services for MLOps and LLMOps, for logging you can use SageMaker experiments, SageMaker Model Monitor for model monitoring, SageMaker model registry for model versioning and BedRock is meant to abstract complexities in SageMaker. SageMaker also integrates with Opensource tools like Mlflow, which you can use as an alternative for model tracking and registry. See these workshops to get started, they cover most of your question https://catalog.workshops.aws/mlops-from-idea-to-production/en-US and LlMops https://catalog.us-east-1.prod.workshops.aws/workshops/958877b7-af54-434e-8133-15bbb7693947/en-US

Awwal
answered 3 months ago
0

Hi,

This blog post is very interesting in relation to your question: https://aws.amazon.com/blogs/machine-learning/mlops-foundation-roadmap-for-enterprises-with-amazon-sagemaker/

It describes the full roadmap (incl. the right services to use) for enterprises willing to implement MLOps on AWS.

This one is more specific to LLMOps: https://aws.amazon.com/blogs/machine-learning/fmops-llmops-operationalize-generative-ai-and-differences-with-mlops/

Best,

Didier

profile pictureAWS
EXPERT
answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions