Developer Tests Own Linting Plugins Against Competitor's Suite, Finds 93% Coverage on Active Rules
A developer benchmarked their linting plugins against eslint-plugin-security by running that competitor's own published test suite — 84 code samples — rather than comparing rule-name counts. Their plugins flagged 51 of 84 samples versus the competitor's 71, but 29 of those misses came from a single rule targeting a Node.js buffer argument removed in Node 10. Excluding that deprecated rule, coverage rose to 93% of still-relevant cases. Notably, the developer's plugins caught all 13 samples that eslint-plugin-security's own implementation failed to flag on its own test cases. However, the developer cautioned that corpus benchmarks only measure coverage, not precision — their plugins produced 279 false positives when run against real-world code, a problem no curated test suite can expose.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in