The LLM Judge That Kept Agreeing With Itself

What a production incident taught me about trusting a model to judge another model's work