Skip to content

Can I use an attachment in Bedrock Evaluations?

0

Is it possible to run Bedrock Evaluation and use attached file with prompts? Ie. something like using prompt "is this cat or dog?" about provided image.

EXPERT

asked a year ago234 views

1 Answer
0

In Amazon Bedrock's evaluation process, you can evaluate prompts at scale, but the current documentation doesn't specifically indicate support for file attachments like images in evaluation jobs.

For working with files in Amazon Bedrock, there are several other approaches available:

  1. The Bedrock Converse API allows you to send documents or long text as part of a message and request that the model describe or summarize the contents.

  2. For image processing specifically, you can use multimodal models like Anthropic Claude 3 Haiku by converting images to base64-encoded strings and including them in your request payload along with your text prompt.

  3. When testing agents with code interpretation enabled, you can attach files that can be used to summarize content, answer queries about file content during conversations, or analyze content for metrics and data visualization.

While these capabilities exist in various Bedrock features, the specific Bedrock Evaluation service documentation doesn't explicitly mention support for evaluating prompts with attached files like images. If you need to evaluate model performance with images, you might need to explore custom evaluation approaches using the standard inference APIs rather than the built-in evaluation tools.
Sources
Attach files to Amazon Bedrock inference request | AWS re:Post
Submit a single prompt with InvokeModel - Amazon Bedrock
Prompts in bedrock evaluation | AWS re:Post
Test code interpretation in Amazon Bedrock - Amazon Bedrock

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.