Get the latest tech news
AI coding tools can reduce productivity
Study Shows That Even Experienced Developers Dramatically Overestimate Gains
METR performed a rigorous study ( blog post, full paper) to measure the productivity gain provided by AI tools for experienced developers working on mature projects. This study doesn’t expose AI coding tools as a fraud, but it does remind us that they have important limitations (for now, at least) – confirming some things my colleague Taren wrote about in a previous post, First, They Came for the Software Engineers…. Coding competition problems are exceptionally small, well-defined, isolated, and greenfield (starting from scratch rather than working in an existing codebase), thus playing directly to AI’s strengths.
Or read this on Hacker News
