Direkt zum Inhalt
Durch die Nutzung von AWS re:Post stimmt du den AWS re:Post Nutzungsbedingungen
AWS re:Postre:Post
Über re:Post

Call Bedrock endpoints from Flutter App

0

Hi,

I want to use AWS Bedrock with Claude and Titan models via its API from a flutter app (iOS for know). Mostly I would use bedrock-runtime endpoint. As far as I understand, none of the proposed SDKs is usable from within flutter. What are my options here?

I've seen this Amplify Tutorial but it hosts a backend using npm bedrock client package. Does this mean I have to host some kind of gateway myself?

Themen
Frontend-Web & MobileMaschinelles Lernen & KIGenerative KI auf AWS
Tags
AWS AmplifyAmazon Bedrock
Sprache
English
gefragt vor 2 Jahren1231 Aufrufe
2 Antworten
0
Akzeptierte Antwort

Hi,

I would suggest to directly use InvokeModel API call. - https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html

To create signature for AWS requests you can refer to this documentation - https://docs.aws.amazon.com/IAM/latest/UserGuide/signing-elements.html

There is also a sigv4 tool for dart - https://aws.amazon.com/blogs/opensource/introducing-the-aws-sigv4-signer-for-dart/

beantwortet vor 2 Jahren
EXPERTE
überprüft vor einem Jahr
  • koromkorom
    vor 2 Jahren

    Hi,

    thank you so much for your answer! This helped a lot. I have one more question though. I am not sure on how to handle authentication. Copying the keys from the aws console and copying them into env vars is not working well for me because they are only have short term validity. Do you know how the AWSCredentialsProvider.profile() constructor is supposed to work? I have completed all these steps with aws cli and have all the files in ~/.aws. When I run flutter with iOS Simulator I am getting: Unhandled Exception: InvalidCredentialsException: Could not load credentials for profile "dev"

0

I wrote an article about using v4Signer from Amplify. Its not specific to flutter, but the principles apply similarly. You will note that this example is calling a lambda function that is calling Bedrock.

Securing lambda calls with Amplify

beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Relevanter Inhalt