- Newest
- Most votes
- Most comments
Hi,
Quite interesting! It is possible to create custom models and submit fine-tuning jobs using APIs. There are a few examples here using Python SDK, there should be similar capabilities using Java SDK.
Please consider the models which are eligible for fine-tuning and the provisioned throughput aspects as described here.
You can control the access to relevant model endpoints using api-gw and lambda so that the users use the corresponding model endpoints.
By the way, your use-case also seems to be a good fit for Retrieval Augmented Generation (RAG), which could be used in select cases as an alternative to fine-tuning. Please check this blog.
Regarding the availability of Bedrock in Europe, I cannot provide you an estimate. I suggest checking here.
Thanks!
Hi,
I would also suggest checking this blogpost, which describes the similar idea: https://aws.amazon.com/blogs/containers/build-a-multi-tenant-chatbot-with-rag-using-amazon-bedrock-and-amazon-eks/
Thank you!
Relevant content
- Accepted Answerasked 4 months ago
- asked 3 months ago
- AWS OFFICIALUpdated 2 months ago
- Can I use ACM to issue private certificates when the AWS Private CA validity is less than 13 months?AWS OFFICIALUpdated 5 months ago
- AWS OFFICIALUpdated 8 months ago
- AWS OFFICIALUpdated 23 days ago
Hi Rama!
Thank you so much for the answer, it helped me a lot!
I have one more question, I don't see clearly the "provisioned throughput" thing. I would need to purchase that in order to be able to use my own trained model?
Thank you!
Hi, I am glad the answer helped! Yes, this is correct, you would need to purchase provisioned throughput in order to deploy a custom fine-tuned model for inferencing. Thanks, Rama
And this is per model? Let's say that I have 2 users in my app and I want to create one model per user to train each chatbot with his own data. I would need to purchase 2 provisioned throughput, one per user?
Thanks!
Hi, The provisioned throughput depends on the model units consumed, I suggest get in touch with your AWS account manager he will help you to get a firm estimate. You can also refer to the examples on this page https://aws.amazon.com/bedrock/pricing/
Meanwhile, Amazon Bedrock is now available in Europe Frankfurt region. https://aws.amazon.com/about-aws/whats-new/2023/10/amazon-bedrock-europe-frankfurt-aws-region/
Thank you!