LLM Optimization Is a Search Problem, and DSPy Makes It Easy

I tried seven ways to make a DSPy program faster and cheaper: three adapters, TOON, a custom adapter I almost wrote, JSON Patch, and finally diffs. Most lost. The real lesson was that DSPy and GEPA made the search cheap enough to run.