Managing LLM Prompt Flows

Question

Is there a framework available for AWS Bedrock for managing the flow of LLM prompts which is analogous to Promptflow on the Microsoft github? I need to build an LLM based application with a nodal structure and be able to selectively bypass appropriate nodes when necessary.

Any suggestions will be appreciated.

Thank You,

Charles Kilpatrick

Any suggestions will be appreciated.

Thank You,

Charles Kilpatrick

Deepika · Answer

Hi, Amazon Bedrock released Prompt Management and Prompt Flows which is in preview. Prompt flow allows you to link FMs, prompts, and many AWS services and tools together seamlessly. You can use the visual builder to drag and drop different components such as prompts, Knowledge Bases, and Lambda functions to automate a workflow. You can look at the video guide here:

https://www.youtube.com/watch?v=_Bmk6peAHao

Riku_Kobayashi · Answer

Hello.

I thought the combination of AWS StepFunctions and Amazon Bedrock might be similar to Promptflow.  
https://aws.amazon.com/jp/blogs/aws/build-generative-ai-apps-using-aws-step-functions-and-amazon-bedrock/  
https://docs.aws.amazon.com/step-functions/latest/dg/sample-bedrock-prompt-chaining.html

Managing LLM Prompt Flows

Add your answer

Relevant content