SShortSingh.
Back to feed

Developer Pre-Commits Pass Criteria to Git Before Testing Claude Code AI Skills

0
·55 views

A developer built three Claude Code skills for AI product managers and, before running any evaluations, committed the pass criteria to a Git repository to prevent post-hoc goal-shifting. The first evaluation run failed, revealing a flaw in the /build-or-not skill, which confidently recommended against building a feature despite having no evidence to draw on. A single rule fix — 'no sample, no decision' — resolved the issue, and the second run passed all gates. Testing the /agent-trust-review skill took four runs, with every failure traced back to errors in the test setup rather than the model itself. Across eight test cases and three runs each, the custom skills consistently outperformed plain Claude on structured refusals and pre-defined decision criteria, at a total cost of roughly $2 per full run.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Tesla Has Not Had a Successful New Product Launch Since JB Straubel Left as CTO

A CleanTechnica article argues that Tesla has not achieved a successful new product launch since co-founder JB Straubel stepped down as chief technology officer. The piece ties the company's product track record to the departure of its longtime technical leader. The article was shared on Hacker News, where it drew 56 points and 17 comments. The source text provided is only a link and discussion metadata, so the specific product examples and reasoning behind this claim could not be verified here.

0
ProgrammingDEV Community ·

Adaptive Neuro-Symbolic Planning Aims to Support Heritage Language Revitalization

A researcher working on embodied AI agents found that existing heritage language revitalization programs lack adaptive, personalized learning pathways responsive to learners' cultural context. The work explores combining neural pattern recognition with symbolic reasoning, augmented by embodiment feedback, to handle complex morphology and cultural pragmatics. The article cites UNESCO's estimate that a language disappears roughly every two weeks, underscoring the urgency. It presents a hybrid model architecture in code, pairing a transformer-based neural component with a rule-based symbolic component. The piece is framed as an exploration of the approach rather than a report on deployed programs.

0
ProgrammingDEV Community ·

Claude Code now falls back to AGENTS.md when a project has no CLAUDE.md

Claude Code version 2.1.277, released September 18, 2026, adds support for reading AGENTS.md in projects that lack a CLAUDE.md file. The behavior is a fallback rather than a merge, so repositories that already have a CLAUDE.md see no change. The option can be toggled under Project instructions in /config, and it is not yet available on Amazon Bedrock, Google Vertex AI, or Microsoft Foundry. The official memory documentation had not been updated at the time of writing and still states that only CLAUDE.md is read, so users are advised to rely on the release notes and verify behavior in their own sessions.

0
ProgrammingDEV Community ·

Commutr rewards walking, cycling and transit over driving in Kitchener-Waterloo

Commutr is a web app that gives users points for replacing car trips with walking, cycling, scooter or transit in Kitchener-Waterloo. The backend verifies each trip from GPS data, scoring distance against mode-based rates and reducing confidence when a trip looks fabricated, with a daily cap and an Eco Score gate on rewards. The app shows live Grand River Transit bus and ION data, falling back to simulated buses when the feed is unavailable. Its Gemini-powered assistant, Muta, plans trips, answers account questions and can operate the app by text or voice. The project was built at CommuniHacks, and its merchants, rewards and route-safety ratings are demo data, with no login implemented yet.