Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

Call Bedrock endpoints from Flutter App

0

Hi,

I want to use AWS Bedrock with Claude and Titan models via its API from a flutter app (iOS for know). Mostly I would use bedrock-runtime endpoint. As far as I understand, none of the proposed SDKs is usable from within flutter. What are my options here?

I've seen this Amplify Tutorial but it hosts a backend using npm bedrock client package. Does this mean I have to host some kind of gateway myself?

Topics
Front-End Web & MobileMachine Learning & AIGenerative AI on AWS
Tags
AWS AmplifyAmazon Bedrock
Language
English
asked 2 years ago1.2K views
2 Answers
0
Accepted Answer

Hi,

I would suggest to directly use InvokeModel API call. - https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html

To create signature for AWS requests you can refer to this documentation - https://docs.aws.amazon.com/IAM/latest/UserGuide/signing-elements.html

There is also a sigv4 tool for dart - https://aws.amazon.com/blogs/opensource/introducing-the-aws-sigv4-signer-for-dart/

answered 2 years ago
EXPERT
reviewed a year ago
  • koromkorom
    2 years ago

    Hi,

    thank you so much for your answer! This helped a lot. I have one more question though. I am not sure on how to handle authentication. Copying the keys from the aws console and copying them into env vars is not working well for me because they are only have short term validity. Do you know how the AWSCredentialsProvider.profile() constructor is supposed to work? I have completed all these steps with aws cli and have all the files in ~/.aws. When I run flutter with iOS Simulator I am getting: Unhandled Exception: InvalidCredentialsException: Could not load credentials for profile "dev"

0

I wrote an article about using v4Signer from Amplify. Its not specific to flutter, but the principles apply similarly. You will note that this example is calling a lambda function that is calling Bedrock.

Securing lambda calls with Amplify

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content