Prompt Caching from First Principles
Why you are paying too much for tokens, how caching actually works, and the math that makes it obvious.
lossfn.com
lossfn.com is an AI/LLM technical blog with deep dives into systems, model behavior, and software engineering craft.
Latest posts
The Loss Function That Writes Back
Coding agents, harness design, and a daily practice for getting less wrong.