내용으로 건너뛰기

Bedrock : analyse graph image and answer questions about it

0

Hello,

Is there in Bedrock a generative multimodal model that could answer direct questions about image content, that could analyse graph image and answer questions about it, that could interpret visual content and generate text responses based on that interpretation ?
Can it be used with following use case:

  • add input one picture that contains a simple graph
  • add input details about the graph content
  • ask questions about the graph (ex: which is the theory about the graph type, comment the graph content with business view)

Thank you,

질문됨 일 년 전219회 조회

1개 답변
0
수락된 답변

Yes, Amazon Bedrock offers several foundation models (FMs) with multimodal capabilities that can analyze graph images and answer questions about them. Specifically, Anthropic's Claude 3 Sonnet and Meta Llama 3.2 90B Vision model have demonstrated impressive capabilities in processing and interpreting visual content like graphs, diagrams, and tables.

These models can handle your use case effectively:

  • You can input a picture containing a simple graph
  • Provide additional context or details about the graph content
  • Ask questions about the graph, including theoretical aspects of the graph type or business interpretations of the data

For example, you could upload a population distribution graph and ask questions like "Which city has the highest number in a specific range?" or "Compare the demographics between different regions." The models can extract contextual information from the graph, even when explicit labels might be absent, and provide insights through natural language responses.

These capabilities are particularly useful for:

  • Visual question answering
  • Chart and graph interpretation
  • Extracting structured information from visual data
  • Combining visual information with additional context to provide comprehensive analysis

To get started with these capabilities, you can use the chat playground feature on Amazon Bedrock, which allows you to interact with and extract information from images directly.
Sources
Read graphs, diagrams, tables, and scanned pages using multimodal prompts in Amazon Bedrock | AWS Machine Learning Blog
Context extraction from image files in Amazon Q Business using LLMs | Artificial Intelligence
Best practices for Meta Llama 3.2 multimodal fine-tuning on Amazon Bedrock | AWS Machine Learning Blog

답변함 일 년 전

전문가

검토됨 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.