New Tool 'zerocase' Catches CI Pipelines That Pass With Zero Tests Run
A developer has released an open-source tool called zerocase, available for both Python and Node.js, that detects a common CI failure mode where test suites, linters, or coverage runs exit with a success code despite executing nothing. The tool works by wrapping a test command and parsing its machine-readable report — supporting formats like JUnit XML, LCOV, TAP, Cobertura, and ESLint JSON — then checking whether the number of actually executed items meets a configurable minimum threshold. It draws a key distinction between a report's total count and its executed count, since skipped, quarantined, or re-run tests inflate totals without confirming real coverage. The tool also guards against stale reports from previous runs and treats unparseable reports as failures rather than silent passes. zerocase depends on a single package called didrun and includes a mutation testing pass to verify its own detection logic holds up.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in