Benchmark of 11 MCP Servers Reveals Token Count Varies Up to 30x by Design
A technical analysis published on September 17, 2026, benchmarked 11 widely used Model Context Protocol (MCP) servers to measure how many tokens their tool definitions consume. The study found dramatic variation: Notion required approximately 19,050 tokens while Puppeteer used only around 610, a difference of over 30 times from a single server installation. Two separate measurement studies were compared, and their results for the same servers diverged by as much as 97%, due to differences in tokenizer methods, server versions, and initial configuration states. Both studies noted that token counts carry little meaning without specifying the counting method and exact server version used. The findings suggest that token budget is a fundamental design constraint for MCP tool development, not merely a performance consideration.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in