Bedrock Agent with knowledgebase metadata search

Question

All,
In my use case I am planning to use the agent with couple of function calls and one knowledgebase search.
While testing I found out that my knowledgebase search needs metadata-based filtering to retrieve correct information.
In “pure” knowledgebase search I can include metadata filtering in either “Retrieve” or “RetrieveAndGenerate” calls (or in console).
However, looks like agents do not provide flexibility to use filtering (and some other functionality for advanced knowledgebase search? At least, I do not see it in either console or API calls. Is it possible to request such functionality by prompt?
I might be able to create my own orchestration using just function calls in agent and knowledgebase separately, but it does not sound right.

Does anybody know how to use advanced knowledgebase functionality in agent orchestrations?
Any help would be greatly appreciated.
Thank you
YK

goriggs · Accepted Answer

You can do this as part of SessionState Object, which agents use.  Documentation here:  https://docs.aws.amazon.com/bedrock/latest/userguide/agents-session-state.html

The example shown uses both 1/ Session Attributes and 2/ KB filters that can be used throughout the agent session.  The retrievalConfiguration can be found at the bottom:

```
{
    "sessionAttributes": {
        "": "",
        "": "",
        ...
    },
    "promptSessionAttributes": {
        "": "",
        "": "",
        ...
    },
    "invocationId": "string",
    "returnControlInvocationResults": [
        ApiResult or FunctionResult,
        ...
    ],
    "knowledgeBases": [
       {
        "knowledgeBaseId": "string",
        "retrievalConfiguration": {
            "vectorSearchConfiguration": {
                "overrideSearchType": "HYBRID | SEMANTIC",
                "numberOfResults": int,
                "filter": RetrievalFilter object
            }
        }
       },
       ...
    ]
}
```

Anna_G · Answer

Hi!

You can find how to add filters in the Agents for Amazon Bedrock Runtime API reference here: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent-runtime_RetrieveAndGenerate.html

This example uses filters:

```
POST /retrieveAndGenerate HTTP/1.1
Content-type: application/json

{
    "input": {
        "text": "What is AWS?",
    },
    "retrieveAndGenerateConfiguration": {
        "knowledgeBaseConfiguration": {
            "knowledgeBaseId": "KB12345678",
            "modelArn": "anthropic.claude-v2:1",
            "retrievalConfiguration": {
                "vectorSearchConfiguration": {
                    "numberOfResults": 5,
                    "filter": {
                        "orAll": [
                            {
                                "andAll": [
                                    {
                                        "equals": {
                                            "key": "genre",
                                            "value": "entertainment"
                                        }
                                    },
                                    {
                                        "greaterThan": {
                                            "key": "year",
                                            "value": 2018
                                        }
                                    }
                                ]
                            },
                            {
                                "andAll": [
                                    {
                                        "in": {
                                            "key": "genre",
                                            "value": ["cooking", "sports"]
                                        }
                                    },
                                    {
                                        "startsWith": {
                                            "key": "author",
                                            "value": "C"
                                        }
                                    }
                                ]
                            }
                        ]
                    }
                }
            }
        },
        "type": "KNOWLEDGE_BASE"
    }
}
```

rajarshighosal · Answer

Hi, 
Currently Agents do not have the capability to invoke KnowledgeBases and pass metadata fileters.
Here is the API reference: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent-runtime_InvokeAgent.html
However, the idea is to use a Action group lamda function to use context from a knowledgebase.
So, to filter search results returned from the knowledgebase you can have filtration logic in the lambda function.

Bedrock Agent with knowledgebase metadata search

Relevant content