My Participation in the METR AI Productivity Study

METR recently released a paper, “ Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity ”. It was a randomized controlled trial where developers were given some tasks to work on using AI, and some without. The surprising headline result was that developers using AI took on average 19% longer to complete their tasks! ( N = 246 tasks, 95% confidence interval ≈…