Get the latest tech news
Anthropic’s new Claude prompt caching will save developers a fortune
Anthropic's prompt caching lets users save prompts and call these up for later sessions with additional context for a lower price.
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. The base price of an input to the Claude 3.5 Sonnet model is $3/MTok, so by paying a little more up front, you can expect to get a 10x savings increase if you use the cached prompt the nexst time. It’s now in something of a “race to the bottom” against rivals including Google and OpenAI when it comes to offering low-priced options for third-party developers building atop its platform.
Or read this on Venture Beat
