How to preserve and extend/override AWS Bedrock Agent session history

Question

Is there any way to retrieve Bedrock Agent session history directly from session data? (Or any other way?) I was also wondering if I can somehow override the session history with e.g. messages loaded from an external data source like DB. Are there any plans to share the session history in session object? I know it's possible to get the messages history from the trace but It does not seem like a production ready solution.

Didier Durand · Answer

Hi,

Part of your solution may be to log all accesses to RAG db as described in my article: https://repost.aws/articles/AR-LV1HoR_S0m-qy89wXwHmw/the-leverage-of-llm-system-prompt-by-knowledge-bases-for-bedrock-in-rag-workflows

This way you will see if the Message API for invocation contains the history of previous prompts in the discussion or not: https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-anthropic-claude-messages.html (I supposed that you use Anthropic's Claude messages)

Best,

Didier

How to preserve and extend/override AWS Bedrock Agent session history

Add your answer

Relevant content