Claude counts MCP server tokens 64% higher than tiktoken, study of 14 servers finds
A developer conducted a structured measurement study across 14 MCP servers on August 18, 2026, comparing token counts between tiktoken (o200k_base), Claude, and Gemini tokenizers. The study found Claude consistently counts schema tokens 47–70% higher than tiktoken, with a median premium of 64.1%, while Gemini stayed within 11% of tiktoken across all tested servers. The GitHub MCP server alone consumed 86,843 tokens under Claude — roughly 43% of a 200k context window — before any user message is sent. Most existing MCP cost studies rely on tiktoken, meaning agents running on Claude face a context load approximately 60% larger than those studies suggest. The researcher published the methodology and results as a reproducible, monthly-updated tool called 'loadline' to address the lack of current, standardised MCP token measurement data.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in