One request to an AI support chat costs $0.0168 on Claude Sonnet 5.5 when every call resends the full prompt. Two changes cut that to $0.0035: prompt caching and sending easy questions to a cheaper
Fri Oct 23 2026 · 10 min read · 2 views
Prompt caching is sold as a saving. It can also be the single largest line on an inference invoice, and the failure is quiet, because a cache write succeeds whether or not anything ever reads it back.
Fri Aug 21 2026 · 6 min read · 12 views
Most advice on agent memory treats it as a storage question. Pick a vector store, summarize when the window fills, move on. That misses the bill.
Wed Aug 19 2026 · 6 min read · 9 views
Every comparison chart ranks AI APIs by price per million tokens. That number does not tell you what a task costs. A model with a lower list price can finish a job for more money than a pricier one,
Sat Aug 08 2026 · 7 min read · 4 views