Study finds AI coding agents vary widely in code revert rates, challenging monolithic comparisons

·2 views

A new study analyzed 37,623 pull requests from December 2024 to July 2025 across 2,807 popular GitHub repositories. It compared code changes made by five commercial AI coding agents against a baseline of human-authored changes. The research found significant variation in post-merge revert rates among different AI tools, ranging from 6.1% to 14.5% within 90 days. The study concludes that treating 'AI-written code' as a single category is misleading due to substantial performance differences between individual agents.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

NUMMI factory model offers blueprint for managing AI-generated code quality

The NUMMI joint venture in 1984 transformed one of GM's worst factories in Fremont, California into a model plant by adopting Toyota's production principles. Central to this success was the andon cord system, which empowered workers to stop production when defects were found. Modern software development has digitized this concept through CI/CD pipelines, automated testing, and feature flags that provide rapid feedback. As AI accelerates code generation, the article argues these quality mechanisms become more critical to prevent unmaintainable output. Engineering leaders must focus on system design and feedback loops rather than pure output metrics when implementing AI tools.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer details cross-platform pitfalls porting .NET app from Windows to macOS/Linux

A developer recently ported a Windows-only .NET desktop application called Filee to macOS and Linux. The process revealed platform-specific bugs not caught in a virtual machine testing environment. Issues included graphics driver dependencies, system locale detection, and differences in how operating systems handle UI elements like tray icons. The developer resolved these by modifying the code and adjusting the testing workflow.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Telegram Channel Preview HTML Exposes Six Attribution Signals

Public HTML previews of Telegram channels, accessible without an account, contain data revealing channel operator information. These signals include subscriber count trends, post ID sequencing, and media thumbnail details, which can indicate growth patterns and content sourcing. Other signals involve analyzing pinned messages, channel descriptions for external links, and observing rate-limit responses to scraping attempts. This data, which is publicly available and often overlooked, can be used for attribution and analysis of channel activity and intent.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

MatrixSwarm's crypto_alert automates cryptocurrency monitoring without exchange keys.

MatrixSwarm's crypto_alert agent automates the monitoring of public cryptocurrency prices and Bitcoin addresses. It evaluates user-defined rules and sends notifications via alert relays without requiring an exchange account or API keys. The agent supports features like price thresholds and address changes, using a shared connection for market data. It is managed through the Phoenix interface, where users can create and edit monitoring rules. The system is designed to eliminate the need for manual, repetitive monitoring tasks.

0 comments Read more at DEV Community