Audit of 36 MCP servers finds a third failing AI agents due to poor documentation
A developer who integrates MCP connectors into production AI agents built a tool called mcpgrade to audit the quality of Model Context Protocol servers beyond basic spec compliance. Scanning 36 popular servers revealed that 11 — including official offerings from MongoDB, Notion, Airtable, and GitHub — scored D or F grades. The dominant failure was rule D004: parameters lacking descriptions, with firecrawl logging 132 such errors out of 134 total and todoist hitting 110. Most failing servers auto-generate schemas from Zod or OpenAPI definitions without adding human-readable descriptions, leaving AI models unable to correctly select or call tools. The author argues that adding parameter descriptions is the single highest-leverage fix developers can make to improve agent reliability.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in