MLOps/LLMOps solution on AWS?

0

What AWS service is relevant for MLOps/LLMOps? What do we use for logging, monitoring, model performance, versioning for ML models on AWS cloud? Is this built into SageMaker?

已提問 4 個月前檢視次數 656 次
2 個答案
0

Yes, SageMaker and BedRock are services for MLOps and LLMOps, for logging you can use SageMaker experiments, SageMaker Model Monitor for model monitoring, SageMaker model registry for model versioning and BedRock is meant to abstract complexities in SageMaker. SageMaker also integrates with Opensource tools like Mlflow, which you can use as an alternative for model tracking and registry. See these workshops to get started, they cover most of your question https://catalog.workshops.aws/mlops-from-idea-to-production/en-US and LlMops https://catalog.us-east-1.prod.workshops.aws/workshops/958877b7-af54-434e-8133-15bbb7693947/en-US

Awwal
已回答 4 個月前
0

Hi,

This blog post is very interesting in relation to your question: https://aws.amazon.com/blogs/machine-learning/mlops-foundation-roadmap-for-enterprises-with-amazon-sagemaker/

It describes the full roadmap (incl. the right services to use) for enterprises willing to implement MLOps on AWS.

This one is more specific to LLMOps: https://aws.amazon.com/blogs/machine-learning/fmops-llmops-operationalize-generative-ai-and-differences-with-mlops/

Best,

Didier

profile pictureAWS
專家
已回答 4 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南