🚀 Introducing Length Value Model (LenVM): a new paradigm for length modeling and a new dimension of scaling.
Tokens are the basic unit of inference compute. Length affects cost, latency, KV cache, and reasoning quality. As long reasoning and agentic workflows get longer, token