Jev gateway does not cut Claude Code costs, its own benchmark confirms
A developer who examined the jev-gateway source code found that the tool can only operate in 'hint' mode inside Claude Code, meaning it suggests a tool to the model rather than forcing a selection. This limitation exists because Anthropic's API returns errors when tools are forced alongside extended thinking, and changing tool_choice invalidates the message cache. The gateway's own README acknowledges the constraint, stating users should expect better tool picks on large tool lists, not lower cost or latency. The published benchmark of 120 sessions shows mixed results: routing reduced token use on one task but increased input tokens by up to 61% and time by 83% on another, with one model also solving a task less reliably when routing was enabled. The viral videos promoting the tool as the cheapest agentic coding loop did not mention these trade-offs or quote the README's own disclaimer.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in