{"id":679756,"date":"2025-07-13T07:00:28","date_gmt":"2025-07-13T04:00:28","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/ai-coding-tools-may-not-speed-up-every-developer-study-shows\/"},"modified":"2025-07-13T07:00:28","modified_gmt":"2025-07-13T04:00:28","slug":"ai-coding-tools-may-not-speed-up-every-developer-study-shows","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/ai-coding-tools-may-not-speed-up-every-developer-study-shows\/","title":{"rendered":"AI coding tools may not speed up every developer, study shows"},"content":{"rendered":"
\n

Software engineer workflows have been transformed in recent years by an influx of AI coding tools like Cursor and GitHub Copilot, which promise to enhance productivity by automatically writing lines of code, fixing bugs, and testing changes. The tools are powered by AI models from OpenAI, Google DeepMind, Anthropic, and xAI that have rapidly increased their performance on a range of software engineering tests in recent years.<\/p>\n

However, a new study<\/a> published Thursday by the non-profit AI research group METR calls into question the extent to which today\u2019s AI coding tools enhance productivity for experienced developers.<\/p>\n

METR conducted a randomized controlled trial for this study by recruiting 16 experienced open source developers and having them complete 246 real tasks on large code repositories they regularly contribute to. The researchers randomly assigned roughly half of those tasks as \u201cAI-allowed,\u201d giving developers permission to use state-of-the-art AI coding tools such as Cursor Pro, while the other half of tasks forbade the use of AI tools.<\/p>\n

Before completing their assigned tasks, the developers forecasted that using AI coding tools would reduce their completion time by 24%. That wasn\u2019t the case.<\/p>\n

\u201cSurprisingly, we find that allowing AI actually increases completion time by 19% \u2014 developers are slower when using AI tooling,\u201d the researchers said.<\/p>\n

Notably, only 56% of the developers in the study had experience using Cursor, the main AI tool offered in the study. While nearly all the developers (94%) had experience using some web-based LLMs in their coding workflows, this study was the first time some used Cursor specifically. The researchers note that developers were trained on using Cursor in preparation for the study.<\/p>\n

Nevertheless, METR\u2019s findings raise questions about the supposed universal productivity gains promised by AI coding tools in 2025. Based on the study, developers shouldn\u2019t assume that AI coding tools \u2014 specifically what\u2019s come to be known as \u201cvibe coders\u201d \u2014 will immedia<\/a>tely speed up their workflows.<\/p>\n

METR researchers point to a few potential reasons why AI slowed down developers rather than speeding them up: Developers spend much more time prompting AI and waiting for it to respond when using vibe coders rather than actually coding. AI also tends to struggle in large, complex code bases, which this test used.<\/p>\n

The study\u2019s authors are careful not to draw any strong conclusions from these findings, explicitly noting they don\u2019t believe AI systems currently fail to speed up many or most software developers. Other large-scale studies<\/a> have shown that AI coding tools do speed up software engineer workflows.<\/p>\n

The authors also note that AI progress has been substantial in recent years and that they wouldn\u2019t expect the same results even three months from now. METR has also found that AI coding tools have significantly improved their ability to complete complex, long-horizon tasks<\/a> in recent years.<\/p>\n

However, the research offers yet another reason to be skeptical of the promised gains of AI coding tools. Other studies have shown that today\u2019s AI coding tools can introduce mistakes<\/a> and, in some cases, security vulnerabilities<\/a>.<\/p>\n<\/div>\n

If you liked the article, do not forget to share it with your friends. Follow us on\u00a0Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n

\n

If you want to read more like this article, you can visit our Technology<\/a><\/span> category.<\/strong><\/p>\n<\/blockquote>\n

Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Software engineer workflows have been transformed in recent years by an influx of AI coding tools like Cursor and GitHub Copilot, which promise to enhance productivity by automatically writing lines of code, fixing bugs, and testing changes. The tools are powered by AI models from OpenAI, Google DeepMind, Anthropic, and xAI that have rapidly increased…<\/p>\n","protected":false},"author":1,"featured_media":679757,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/techcrunch.com\/wp-content\/uploads\/2025\/02\/GettyImages-1356382582.jpg?resize=1200,800","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[77337,154888,154765],"class_list":["post-679756","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-ai","tag-ai-coding","tag-cursor"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/679756","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=679756"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/679756\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/679757"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=679756"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=679756"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=679756"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}