Let’s evaling

Last Friday I had a shower thought about evals. An eval is a repeatable experiment on an LLM system: fixed inputs, one or more variants under test, and a scoring rule that turns outputs into numbers you can compare. That s what Claude tells me anyway. evaling can help you if you ve ever changed a prompt [ ]