Topic

#prompt-caching

16 articles tagged prompt-caching. Browse the full set below, or see all topics.

Tagged "prompt-caching"

Cross-cutting reads on this topic

16 articles
Compare Astra and Fable 5.1 pricing, cache costs, context limits and access rules, then choose a model for coding, document work or long agent runs.
#GPT-6 Astra#Claude Fable 5.1+3 more
2026-09-08
Read Article
Anthropic kept every per-token price and cut one line item 75%. Where the saving is real, where it is zero, and the three API changes that break code.
#anthropic#claude-fable-5-1+4 more
2026-09-01
Read Article
A fixed $200 converted into input tokens at the rate lanes seven vendors publish. Claude Opus 5 alone spans 40M to a derived 800M, a 20x range.
#ai-api-pricing#prompt-caching+5 more
2026-08-31
Read Article
A retry wrapper that cannot tell a spend-cap 429 from a rate-limit 429 burns real money for zero work. Cache math, retry burn and checkpoint economics.
#agent-cost-budgeting#retry-burn+5 more
2026-08-25
Read Article
One fixed Python task, run twice through eight headless coding-agent CLIs, with tokens, wall-clock time and list-price cost measured for every run.
#coding agents#benchmarking+5 more
2026-08-22
Read Article
K3's least-used surfaces are its 1M context, native vision and reasoning-effort dial. Switching effort mid-session forfeits the cache rate that funds it.
#kimi-k3#long-context+5 more
2026-08-01
Read Article
Writer's own research reports a harness redesign cut token spend nearly 40% at steady accuracy. Why the orchestration layer, not the model, sets AI cost.
#ai-harness#llm-orchestration+5 more
2026-07-21
Read Article
Running Kimi K3 in Kimi Code: the Moderato plan unlocks 256K context, Allegretto the full 1M, and cache discipline — not knobs — controls your real cost.
#kimi k3#kimi code+5 more
2026-07-17
Read Article
OpenAI's GPT-5.6 caching overhaul, plus Anthropic and DeepSeek tiers, reshapes agent cost math. How to design cache-first, model-homogeneous agents.
#AI Development#Prompt Caching+5 more
2026-07-16
Read Article
Claude Fable 5 lists at $10/$50 per million tokens and meters after July 7. How prompt caching, the Batch API, and spend caps cut the bill — with worked math.
#Claude Fable 5#Prompt Caching+5 more
2026-07-02
Read Article
Uber burned a year's AI budget in four months; Microsoft cut Claude Code. A 4-gate playbook that right-sizes model spend and cuts AI bills 60 to 80 percent.
#ai-cost-optimization#model-routing+5 more
2026-06-23
Read Article
Prompt caching reuses computed KV tensors so repeated prefixes cost up to 90% less, with no quality loss. The 2026 cross-provider engineering playbook.
#prompt-caching#llm-cost-optimization+6 more
2026-06-16
Read Article
Opus 4.8 tops the Artificial Analysis index, but GPT-5.5 still leads Terminal-Bench. An evidence-graded roundup of the first 48 hours of independent evals.
#claude-opus-4-8#ai-benchmarks+5 more
2026-05-30
Read Article
A FinOps playbook for cutting AI inference spend without quality loss: model routing, prompt and KV caching, batching, quantization, and unit-cost tracking.
#inference-cost#ai-finops+6 more
2026-05-26
Read Article
Tokens, prefill, decode, KV cache, prefix cache, batch tier, reserved capacity, context-window discount — every LLM billing term, defined.
#token-economics#llm-cost+8 more
2026-04-30
Read Article
When 1M context pays off — and when it bankrupts you. Token-spend math, prompt-cache strategy, and break-even tables for agentic Claude Opus 4.7 workloads.
#claude-opus-4-7#anthropic+8 more
2026-04-23
Read Article