SShortSingh.
Back to feed

AI-assisted commits show a fix-rate gap in one small repo study, but the control group is flawed

0
·8 views

A developer checked whether their own side projects mirrored a Harvard working paper that found coding agents raised pull request volume while slowing review. Comparing commits with and without an AI co-author trailer, they initially saw AI commits starting with fix or revert at more than double the rate. Closer inspection showed the no-trailer group was almost entirely one scaffolding day with unknown authorship, and that AI commits used feat/fix naming and touched more files. When the analysis counted per file instead of per commit, the gap disappeared, with roughly 46% versus 47% of touched files being re-edited within 72 hours. The author concludes that two repos cannot show whether AI-assisted work gets fixed more or less, and that the original result came from naming habits, a one-day control group and commit size.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Decoupling Laravel Telegram Webhooks with Queues and Redis Locks to Prevent Timeouts

Synchronous processing in a Laravel Telegram bot can exceed Telegram's webhook timeout when traffic spikes or upstream APIs slow down. Telegram then retries the same update repeatedly, which can cause duplicate orders, repeated charges, and spam notifications. The article recommends acknowledging webhooks immediately, pushing raw payloads to background queue workers, and using atomic locks keyed on the update_id to ensure each update is processed only once. It also stresses verifying the X-Telegram-Bot-Api-Secret-Token header with a dedicated middleware using hash_equals, so forged requests are rejected at the HTTP boundary.

0
ProgrammingDEV Community ·

Developer's Four Scripts Automate Stock Asset Packaging on a 2 GB Server

A developer describes how a rejected Adobe Stock upload, caused by an incorrect CSV header, led them to automate metadata creation. Their make_metadata.py script generates the exact header format each platform requires, while a tracker script prevents duplicate submissions after accidental re-runs. Additional tools convert Markdown to styled PDFs and bundle products with generated cover images and thumbnails. The whole pipeline was built to run within the limits of a single-core server with 2 GB of RAM.

0
ProgrammingDEV Community ·

CodeSmith's Tool Architecture: Three Layers Funnel Dozens of Tools Into One Slot

CodeSmith, at version 0.5.0, offers roughly fifty built-in tools plus extension tools from MCP servers, dynamic libraries, and subagents, all plugged into a single interface. The design is organized in three layers: a minimal, host-agnostic framework Tool contract at the bottom, a production ToolSpec that carries most of the functionality, and a ToolDispatcher seam that keeps the engine core independent of the TUI. A central choice is that approval requirements are derived from declared capabilities, so tools that execute code require approval, tools that write files are suggested for approval, and others run automatically. The article notes that the dispatcher exists because the host context carries many terminal-specific services that cannot live in the runtime crate. Together these layers let the engine work against an interface rather than concrete host implementations.

0
ProgrammingDEV Community ·

17,856 Publicly Reachable MLflow Servers Found in ZoomEye Index

A ZoomEye scan on 2026-10-12 returned 17,856 reachable MLflow instances, an experiment tracking and model registry platform now widely used in production. Such servers often hold datasets, model weights, evaluation outputs, and sometimes credentials logged as parameters. Many were deployed for research on shared infrastructure, alongside training environments, or with default settings that lack authentication. Without authentication, an exposed server can allow run creation, parameter logging, and artifact retrieval, potentially reaching the underlying object store. The count is likely a lower bound, since servers behind proxies without recognizable interfaces are not captured.