Use prompt caching with open-weight models on Amazon Bedrock | Amazon Web Services
Many generative AI applications resend the same long context on every request. Prompt caching lets open-weight models on Amazon Bedrock reuse it to reduce input cost and latency. This post shows implicit and explicit caching through the Chat Completions API and applies caching to an OpenCode coding agent session.
Amazon Web Services ยท https://www.facebook.com/amazonwebservices
Topics: Coding Agents
Entities: Coding Agents