LLM Inference Interview Questions #4 - The Best-of-N Paradox

Why buying agent accuracy on a logarithmic curve silently destroys your inference budget, and the exact economic threshold where a 16x compute multiplier is actually justified.