Predicting LLM Parameters Using Benchmarks

In a recent episode of the Latent Space podcast ( Artificial Analysis: The Independent LLM Analysis House — with George Cameron and Micah Hill-Smith ), the Artificial Analysis team pointed out a strong correlation between model performance on their AA-Omniscience Accuracy benchmark and the model&rsquo;s parameter count: An interesting thing about this accuracy metric is that it tracks more closely…