Skip to content

Is it possible to use an outside embedding model instead of the ones provided in Amazon Bedrock?

0

I have a RAG application based on S3->Bedrock->OpenSearch Serverless. I am currently using Amazon Titan G1 text 02 for embedding and Amazon Nova Pro for querying. Is it possible to use some outside model that isnt provided by amazon as the embedding model?
If so - how do I do that? Thank you. I have been told SageMaker may help in some way.

1 Answer
0

Hi Zach, You have several options available within Amazon Bedrock for embedding model inference. If you’d like to continue using on-demand inference, you can alos consider Cohere Embedding Models (Embed English and Embed Multilingual), or Amazon’s own embedding models such as Titan Text Embeddings V2, Titan Multimodal Embeddings G1, and Titan Embeddings G1 - Text.

Additionally, you can explore other models available in the Amazon Bedrock Marketplace. Once you find a model that fits your needs, you can subscribe to it and deploy it to an endpoint managed by SageMaker AI.

If you're interested in using a different model, you can also easily deploy one using SageMaker JumpStart—a hub of pre-trained, open-source models for a variety of tasks, including embeddings.

Of course, you always have the option to bring your own model and deploy it in SageMaker AI. For example, this article demonstrates how to deploy a Hugging Face embedding model in SageMaker and consume it using LlamaIndex.

AWS

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content