Cost and Latency Belong in the Score

Congratulations, the best model available passed your eval. That&rsquo;s not the question you should be answering. What other models could have achieved equivalent results? How much did it cost to run those other models? How long did it take for those other models to achieve equivalent results? All of these are the questions that you should be asking yourself. If the only thing you&rsquo;re…