Measuring Agent Reliability: pass@k, pass^k, and LLM Judges

A system that succeeds once is capable. A system that succeeds repeatedly is reliable. Here is how to measure both, choose the right repeated-run metric, and use LLM judges without trusting them blindly.