Open-source tool tokenscope helps developers track hidden AI agent context costs

·1 views

A new open-source CLI tool called tokenscope lets developers scan their AI agent codebases and estimate the token footprint of prompts, tool schemas, and configuration files. The tool addresses a growing cost problem: most AI agent frameworks resend accumulated context on every model call, meaning a single bloated prompt multiplies across every request and every user. Developers can run tokenscope locally with a single npx command, integrate it as a pre-push Git hook, or deploy it as a GitHub Actions check to flag token-cost increases on pull requests. The tool is tokenizer-free and provides relative estimates rather than exact billing figures, requiring no API keys or provider SDK setup. It is released under the Apache-2.0 license and is available on npm and GitHub.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

France bans unsolicited telemarketing calls starting August 11

France is set to implement a ban on unsolicited telemarketing calls, with the measure taking effect on August 11, 2026. The move aims to protect consumers from unwanted commercial solicitations by phone. The policy represents a significant shift in how businesses are permitted to reach potential customers in France. The ban reflects growing public frustration with intrusive telemarketing practices across the country.

0 comments Read more at Hacker News

ProgrammingDEV Community ·

AI Evals Explained: Why Product Teams, Not Engineers, Must Define Quality

AI evaluations (evals) are structured systems that track whether an AI product's output quality changes over time, helping teams avoid subjective debates about performance degradation. At their core, evals consist of real user queries, written criteria for what a good response looks like, and a repeatable method to check outputs against those criteria. The central challenge is not technical but organizational: someone must explicitly define what 'correct' means for each use case, including tone, accuracy, and acceptable trade-offs. Experts argue that product managers should own these quality definitions in plain prose, while engineers handle the automated testing infrastructure. Teams that fail to assign clear ownership risk having product judgements made by default, embedded silently into dashboards and test scripts by whoever built them.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Kimi K3's 2.81T Parameters Put It Far Beyond Any Mac's Memory Capacity

Kimi K3 is a mixture-of-experts model with 2.81 trillion parameters, requiring roughly 1.4 TB of memory even at 4-bit quantization — far exceeding the 512 GB maximum available on Apple's most powerful Mac Studio. Despite MoE architecture activating only a small fraction of experts per token, all experts must remain in memory since the router can call any of them at any moment, meaning sparse activation reduces compute but not memory footprint. Ollama's only available Kimi K3 tag is labeled ':cloud', which silently routes requests to Moonshot's remote servers rather than running inference locally on the user's machine. In practical testing on a 128 GB MacBook M4 Max, the Qwen2.5-Coder 14B model delivered 13.3 tokens per second versus 5.6 tok/s for the 32B variant, making the smaller model significantly more usable for agentic workflows. The 14B model also fits within 16 GB of unified memory, meaning the base $599 Mac mini can run a capable local coding model despite being unable to handle frontier-scale models like Kimi K3.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Builds Local AI Infrastructure to Reduce Cloud Dependency

A software developer has shared their journey of shifting focus from cloud-based systems to self-hosted, local AI infrastructure setups. Facing challenges like hardware bottlenecks and pipeline optimization, they worked to maximize performance on standard consumer hardware. Among their recent projects is an Employee Tracker tool designed to handle workforce management, attendance, and task monitoring with a focus on speed and data security. They have also been experimenting with local AI deployments using tools like ComfyUI to reduce output latency and improve resource efficiency. Looking ahead, the developer plans to build autonomous agents, expand local server capabilities, and release open-source utilities to help others run high-performance AI stacks independently.

0 comments Read more at DEV Community