Developer Finds Self-Test Suite Misses All Critical Failure Paths in Commit-Message Script

A developer discovered that the --selftest block in their git_commit.py script contains eight assertions that exclusively test a regex filter, leaving all five real failure branches completely untested. The script, which reads staged diffs and calls an AI CLI tool to generate commit messages, has distinct exit paths guarding against subprocess timeouts, an empty staging area, a missing binary, and non-zero process exits. The gap went unnoticed until the developer audited their own test coverage after reading about the pitfalls of counting assertions without examining what they actually exercise. By contrast, two other files in the same repository had self-tests written the same week that properly stubbed network and subprocess calls to exercise genuine failure modes. The case highlights how a passing test suite can create false confidence when tests validate only low-risk pure functions while skipping the error-prone code paths that matter most.