§ feed · storyline

Prompt Caching in the API

Anthropic adds prompt caching to its API, automatically discounting repeated input tokens the model has recently processed.

Oct 1 · 12:03:00 · primary fetch1 sourceupdated Oct 1 · 12:03:00

Offering automatic discounts on inputs that the model has recently seen

§ sources1 publication · timeline below