Get the latest tech news
AI coding tools may not speed up every developer, study shows
A new study from the non-profit METR suggests that AI coding tools may not offer productivity gains for experienced developers.
The tools are powered by AI models from OpenAI, Google DeepMind, Anthropic, and xAI that have rapidly increased their performance on a range of software engineering tests in recent years. METR conducted a randomized controlled trial for this study by recruiting 16 experienced open-source developers and having them complete 246 real tasks on large code repositories they regularly contribute to. The study’s authors are careful not to draw any strong conclusions from these findings, explicitly noting they don’t believe AI systems currently fail to speed up many or most software developers.
Or read this on TechCrunch
