Number-Verification Gates Miss False Claims If No Figures Are Involved

A developer discovered that their automated fact-checking pipeline, which verified every numerical figure against its source, still allowed fabricated narrative claims to pass undetected. Of 79 AI-generated drafts that cleared the gate, 8 contained false first-person assertions — such as claiming a web scraper was built or deployed — because those statements carried no numbers for the gate to check. A manual review of all 79 drafts was required to identify and discard the problematic eight. In response, the developer expanded the pipeline to cross-reference every first-person action verb in a draft against a personal log of work actually performed. The fix introduces occasional false rejections when wording differs between the draft and the log, but the developer considers that an acceptable trade-off.