citefid 0.1.0 tool verifies if wiki citations actually support their claims
A new open-source tool called citefid has been released to address a gap in LLM-generated wikis that follow the Open Knowledge Format (OKF) standard. While existing OKF wiki pipelines only check that cited files exist and line ranges are valid, they do not verify whether the cited content actually supports the stated claim. citefid fills this gap by taking a claim and its citation, then using a Natural Language Inference (NLI) model to determine whether the source fragment confirms, contradicts, or is neutral toward the claim. Tested on 206 code and CRD pairs from a real Crossplane claim-ledger, the tool achieved an AUC of 0.7219 using retrieved passages versus 0.7029 on raw truncated spans. The release is described as a functional MVP, with a planned second phase to add an LLM-as-judge layer for code and numerical edge cases.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in