Use AWS Bedrock to train own private models per user, so each can have his own private trained models, is this possible?

Question

Hi! I would like to know if with the AWS Bedrock Java SDK I can create a fine tuning model per user that will be trained periodically by my system behind the scenes, so each user has his own private models and later when the user interact with the custom chatbot built in my app using behind the scenes AWS Bedrock, the chatbot can give each user their own personalized responses learned from their own trained private models. Is this possible?
Also do you know how much time it will take for AWS to release Bedrock in european regions?

Thank you guys!

Answer

Hi,

Quite interesting! It is possible to create custom models and submit fine-tuning jobs using APIs. There are a few examples [here](https://docs.aws.amazon.com/bedrock/latest/userguide/model-customization-api.html) using Python SDK, there should be similar capabilities using [Java SDK](https://sdk.amazonaws.com/java/api/latest/).

Please consider the models which are eligible for fine-tuning and the provisioned throughput aspects as described [here.](https://docs.aws.amazon.com/bedrock/latest/userguide/custom-models.html)

You can control the access to relevant model endpoints using api-gw and lambda so that the users use the corresponding model endpoints.

By the way, your use-case also seems to be a good fit for Retrieval Augmented Generation (RAG), which could be used in select cases as an alternative to fine-tuning. Please check this [blog.](https://aws.amazon.com/blogs/machine-learning/simplify-access-to-internal-information-using-retrieval-augmented-generation-and-langchain-agents/)

Regarding the availability of Bedrock in Europe, I cannot provide you an estimate. I suggest checking [here.](https://docs.aws.amazon.com/bedrock/latest/userguide/what-is-bedrock.html#bedrock-regions)

Thanks!

Answer

Hi,

I would also suggest checking this blogpost, which describes the similar idea: https://aws.amazon.com/blogs/containers/build-a-multi-tenant-chatbot-with-rag-using-amazon-bedrock-and-amazon-eks/

Use AWS Bedrock to train own private models per user, so each can have his own private trained models, is this possible?

相關內容