RepoTrials lets teams benchmark AI coding agents against their own Git history

·1 views

RepoTrials is a new open-source, local-first tool released under the Apache 2.0 license that converts existing Git commit history into repeatable benchmarks for evaluating AI coding agents. Rather than relying on public leaderboards, engineering teams can test which agent, model, or prompt configuration performs best on their own codebase. The tool reconstructs historical moments when a test was failing and packages them as sealed tasks, then grades agents by checking whether the relevant tests pass without breaking existing ones. Task data, hidden tests, and run artifacts remain stored locally, keeping proprietary code private while the engine stays open. Version 0.1.0 is now available on GitHub and currently works best with Python repositories that have reproducible historical tests.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Shiksha AI and Mitra AI offer voice-based English practice for Indian learners

Two AI voice agents, Shiksha AI and Mitra AI, have been developed to help Indian students, job seekers, and young professionals improve their spoken English skills. The platform was built for the Voice for Bharat Challenge 2026 and addresses common barriers such as social anxiety and lack of conversational practice partners. Shiksha AI acts as a patient tutor guiding turn-by-turn spoken practice, while Mitra AI handles real-life roleplay scenarios like ordering food or attending job interviews. The system supports Hinglish and Devanagari script, and is accessible via web browsers as well as telephone and SIP calls. It is powered by Murf Falcon TTS, LiveKit Agents, Deepgram Nova-3, and Google Gemini, with features including persistent learner memory and automated daily practice calls.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

GDXMS2 Brings MiniScript 2 Scripting Support to Godot 4 via New Bindings

A developer has released Godot-X-MiniScript2 (GDXMS2), an open-source project that integrates the MiniScript 2 interpreter into the Godot 4 game engine. The bindings are available in both C++ and C# implementations, using GDExtension and GodotSharp respectively. The project was created partly to support developers who want to submit MiniScript entries to the Micro Jam game jam while continuing to use Godot. GDXMS2 can also serve as a lightweight scripting alternative to Lua for game modding or as an embedded interpreter within Godot projects. The project is in its early stages but is described as usable via its latest release or by building from the most recent commit on GitHub.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Anthropic's Claude Watermark Explained: What It Does and Does Not Prove

Anthropic signed the EU AI Act's Code of Practice on Transparency and began embedding an invisible statistical watermark in text generated by Claude. The watermark has documented limitations: it can persist even in human-written text that Claude merely edited or translated, and its absence does not confirm a text was written entirely by a human. Commentary online has conflated this watermark with unrelated third-party AI detectors like ZeroGPT and with individual platform moderation decisions, treating them as a single automatic chain. Experts and careful readers note that detecting model involvement in a text is fundamentally different from concluding the text was 'written by AI.' The broader debate sidesteps a key distinction: whether a human retained editorial control over the idea, structure, and final output throughout the process.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Six Free Self-Paced Web Accessibility Courses Worth Taking This Summer

A curated list of six free, self-paced online accessibility courses has been recommended for learners at various proficiency levels. The selection includes UNITAR's Inclusive Learning Design, which covers intersectionality, disaggregated data, and gender perspectives in roughly two hours. The International Labour Organization offers a course on disability inclusion strategies in the workplace, aimed especially at HR and culture professionals. Accessible EU's Accessible Technology Design, now in its fourth edition, covers WCAG, inclusive design patterns, and cognitive accessibility across seven structured modules. All courses are available online at no cost, making them accessible options before investing in paid certifications.

0 comments Read more at DEV Community