AWS Bedrock Knowledge Base - Test Knowledge Base does not allow to select different model other than Anthorpic

Question

Hello,
I have enabled multiple models such as Amazon Titan, Jurasic, Llama 2 etc.  I created a knowledge base.  When I click on Test the only option is to select Anthropic Model (which I have not enable).  How do I use different model?

Answer

Currently the Bedrock Knowledge Base is limited to Anthropic Claude models. If you want to test a similar system to Bedrock Knowledge base that gives you the possibility to use all Bedrock models and also third-party models hosted via SageMaker endpoints and select the document storage (OpenSearch, Aurora or Kendra), you can have a look at https://github.com/aws-samples/aws-genai-llm-chatbot.

This is not a replacement for a managed service like Bedrock Knowledge Base, but can allow you to evaluate this type of solutions which you can possibly build and deploy yourself.

AWS Bedrock Knowledge Base - Test Knowledge Base does not allow to select different model other than Anthorpic

Relevant content