LLM Preference Evaluation: Pairwise Comparisons and Elo

Evaluate language models with pairwise comparisons and Elo ratings, including preference aggregation, confidence intervals, bias, and significance tests. Read full notebook