Call Bedrock endpoints from Flutter App

Question

Hi,

I want to use AWS Bedrock with Claude and Titan models via its API from a flutter app (iOS for know). Mostly I would use bedrock-runtime endpoint. As far as I understand, none of the [proposed SDKs](https://docs.aws.amazon.com/bedrock/latest/userguide/api-setup.html#api-sdk) is usable from within flutter. What are my options here?

I've seen this [Amplify Tutorial](https://docs.amplify.aws/flutter/build-a-backend/restapi/gen-ai/) but it hosts a backend using npm bedrock client package. Does this mean I have to host some kind of gateway myself?

Bhavyesh · Accepted Answer

Hi,

I would suggest to directly use InvokeModel API call.  - https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html

To create signature for AWS requests you can refer to this documentation - https://docs.aws.amazon.com/IAM/latest/UserGuide/signing-elements.html

There is also a sigv4 tool for dart - https://aws.amazon.com/blogs/opensource/introducing-the-aws-sigv4-signer-for-dart/

Nathan Wayne Hanks · Answer

I wrote an article about using v4Signer from Amplify. Its not specific to flutter, but the principles apply similarly. You will note that this example is calling a lambda function that is calling Bedrock.

Securing lambda calls with Amplify

[Securing lambda calls with Amplify](https://medium.com/@nathanhanks/calling-iam-secured-lambda-function-urls-with-amplify-and-javascript-551f589b5b55)

Call Bedrock endpoints from Flutter App

添加回答

相关内容