My Metric Was Valid. It Just Stopped Putting Things In Order.

For two months I optimized a score that had stopped ranking my models. It was still a valid measure of quality. It had just gone blind at the resolution I was working at, and three lines of code would have told me.