Review: Measuring AI Ability to Complete Long Software Tasks

Measuring AI Ability to Complete Long Software Tasks , a paper by dozens of authors working at Model Evaluation & Threat Research (METR) . They define the &ldquo;time horizon&rdquo; metric and show that LLMs&rsquo; time horizons have been doubling every seven months, and this growth might have recently accelerated. (See also Murat&rsquo;s summary .) Summary An AI agent&rsquo;s &ldquo;time…