AI companies' eval reports mostly don't support their claims

AI companies claim that their models are safe on the basis of dangerous capability evaluations. OpenAI, Google DeepMind, and Anthropic publish reports intended to show their eval results and explain why those results imply that the models' capabilities aren't too dangerous. 1 Unfortunately, the reports mostly don't support the companies' claims. Crucially, the companies usually don't explain why…