Start With Ten Tasks You Actually Do

Public benchmarks of large language models are a fine way to compare models in the abstract, but they&rsquo;re close to useless for answering questions about things that actually matter. Generally, it&rsquo;s helpful to know which model is the best in general at a specific benchmark, but it doesn&rsquo;t answer the question of which model is the best at that specific thing you ask it to do all day…