AWS Builder Center: Learn, Build and Connect with builders in the AWS community

AWS Builder Center is the official home for builders on AWS. Share and read what others are working on, follow people who inspire you, explore training and workshops, and find tools to support what you're building.

Prompt Caching in Bedrock / Anthropic

I read the recent release on Prompt Caching for Anthropic models here: https://www.anthropic.com/news/prompt-caching
When will Prompt Caching be available in Bedrock?? Is there any material about how to implement Prompt Caching on Bedrock?

Thanks

Topics: Machine Learning & AI Generative AI on AWS
Tags: Machine Learning & AI Generative AI on AWS Amazon Bedrock
Language: English

Alex

asked 2 years ago3.4K views

2 Answers

Newest
Most votes
Most comments

As of August 14, 2024, Anthropic has introduced Prompt Caching for its Claude models, specifically for Claude 3.5 Sonnet and Claude 3 Haiku, with plans to extend support to Claude 3 Opus soon. The information provided does not explicitly mention when or if Prompt Caching will be available in Bedrock. Keep an eye on official announcements from Anthropic for updates regarding Bedrock integration.