Prompt caching is sold as a saving. It can also be the single largest line on an inference invoice, and the failure is quiet, because a cache write succeeds whether or not anything ever reads it back.
Fri Aug 21 2026 · 6 min read · 4 views
Most advice on agent memory treats it as a storage question. Pick a vector store, summarize when the window fills, move on. That misses the bill.
Wed Aug 19 2026 · 6 min read · 5 views
Every comparison chart ranks AI APIs by price per million tokens. That number does not tell you what a task costs. A model priced at $0.14 per million input tokens can finish a job for more money than
Sat Aug 08 2026 · 7 min read · 2 views