The Measurement Was Harder Than the Model

I distilled a 1.7B model into a BLS tool-calling agent. Six measurement mistakes in a row, a val-loss trap that was a config bug, a fix that came from changing what the model says rather than how it trains, and a lesson about what happens when your test failures and your usability requirements overlap.