Research on AI coding assistants shows mixed productivity results across studies
Studies on AI coding assistants do not agree on a single productivity figure. A 2022 GitHub experiment found developers completed a clearly specified HTTP server task 55% faster with Copilot. A field experiment across thousands of workers reported about a 26% rise in completed tasks, with less experienced developers gaining the most. A METR randomised trial, however, found experienced developers working in large codebases they already maintained took 19% longer with AI, even though they believed it had sped them up. Google's DORA research links AI adoption to higher team throughput but a negative effect on delivery stability.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in