Get the latest tech news
AI coding may not be helping as much as you think
Coding has been the strongest use case. But a new study from METR just dropped.
METR did something a lot more hard-core, “Developers completed 245 tasks in mature projects on which they have an average of 4.9 years of prior experience.” We expect AI tools provide greater productivity benefits in other settings (e.g. on smaller projects, with less experienced developers, or with different quality standards). And they, perhaps, a bit more optimistic about the pace of AI progress than I, add “We don’t think our results represent a fundamental limitation in model capability, or rule out a rapid change in the metric being studied soon.”
Or read this on Hacker News