AI

Simulated model provider outage drill comparing retry policies, a circuit breaker and a fallback on 12,000 AI requests

Outage drill: a fallback saved 2,452 failed AI requests

When a model provider slowed down for 60 seconds in a simulation of 12,000 requests, a client with plain retries failed 18.5 percent of them and sent 1.62 provider calls for every user request. Adding

Fri Oct 23 2026 · 11 min read · 1 views

AI

AI agent jobs with checkpoints, comparing whole-job retries against per-step checkpointing on wasted model calls and duplicate side effects

Checkpointed agent jobs wasted 5x fewer model calls

Retrying a whole ten-step AI agent job after any failure wasted 4,143 model calls on 2,000 jobs, lost 75 jobs for good, and ran the email step twice for 273 jobs. Saving a checkpoint after each step

Fri Oct 23 2026 · 10 min read · 2 views

AI

Usage metering for AI SaaS billing, comparing a naive counter with a deduplicating ledger on 200,000 usage events

Duplicate usage events overbilled an AI SaaS bill by $115

A plain usage counter overbilled $3,266.75 of AI usage by $114.86, a 3.5 percent error, because the queue delivered 6,984 events twice. All 500 tenants were billed wrongly. Recording each event once

Fri Oct 23 2026 · 9 min read · 1 views

AI

Multi-tenant AI SaaS job queue where one noisy tenant delays other tenants, compared across four scheduling fixes

A noisy tenant made everyone wait 9.6 seconds: four fixes

In a shared FIFO queue, one tenant's burst of 2,000 AI jobs made every other tenant wait 9.6 seconds at the 95th percentile. A fair queue with no hard cap cut that to 27 milliseconds, and the noisy

Fri Oct 23 2026 · 10 min read · 1 views

AI

Cost model for an AI support chat in a SaaS product, comparing per-request cost across caching and model routing

What an AI chat request really costs: $0.017 or $0.0035

One request to an AI support chat costs $0.0168 on Claude Sonnet 5.5 when every call resends the full prompt. Two changes cut that to $0.0035: prompt caching and sending easy questions to a cheaper

Fri Oct 23 2026 · 10 min read · 2 views

AI

Bar chart of TypeScript errors at each stage of upgrading an AI SDK 6 app to version 7, with the codemod stage still failing at runtime

AI SDK 7 upgrade: the codemod compiles, but a tool breaks

We upgraded a 55-line AI SDK 6 chat app to version 7.0.148 and ran the official codemod. TypeScript went from 4 errors to 1, then to 0 after one manual fix, but two things still changed at runtime

Thu Oct 22 2026 · 10 min read · 0 views

AI

Logos of Fin, HubSpot, Zendesk and Salesforce Agentforce beside a price per resolved support ticket

What an AI-resolved support ticket really costs in 2026

AI customer support agent pricing per resolution runs from $0.50 to about $4.00 for the same solved ticket. HubSpot charges $0.50 per resolved conversation, Fin charges $0.99, and Zendesk charges

Mon Oct 19 2026 · 10 min read · 3 views

AI

GitHub Copilot logo with the range of agent sessions 1,500 AI credits buy

Copilot Pro at $10: how far do 1,500 AI credits go?

Copilot Pro costs $10 a month and includes 1,500 GitHub AI Credits. How far that goes depends almost entirely on the model you pick. On GitHub's published rates, the same agent session costs 3.4

Sun Oct 18 2026 · 10 min read · 3 views

AI