SShortSingh.
Back to feed

Agent cost tracking is broken: token counts don't reveal which AI call spent what

0
·22 views

Most AI cost dashboards show correct totals but cannot break down spending by individual agent run, tool call, or retry, making it impossible to identify what drove a bill higher. OpenTelemetry's GenAI conventions currently define no cost attributes in their published spec, and the open proposal has remained unresolved since August 2026. Cloud cost monitors like AWS Anomaly Detection operate on up to a 24-hour delay and evaluate only about three times daily, meaning alerts arrive after money is already spent. Complicating matters further, identical tokens can be billed at vastly different rates depending on cache state, creating up to a 12.5x price swing that raw token counts do not capture. Without per-span cost attribution built into the observability stack, engineers are left unable to trace large bills — illustrated by one reported case where roughly 100 agent instances accumulated over $1.3 million in a single month.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

When Electric Cars Were Marketed to Women: A Look at Early EV History

An IEEE Spectrum article revisits the early history of electric vehicles, when they were promoted as a preferred option for women drivers. The piece examines how electric cars were positioned in the late 19th and early 20th centuries, when they competed with gasoline and steam-powered vehicles. It draws on the period's marketing and ownership patterns to explain why electric models were seen as clean, quiet, and easy to operate. The article also considers how these early designs later faded from the mainstream as gasoline cars became dominant.

0
ProgrammingDEV Community ·

Afterlight: A Local AI Tool for Preserving Memories of Everyday Objects

A developer submitted Afterlight to a Hacktoberfest open-source AI challenge, themed around the question of what technology should not do with memory. The app is a private archive where users describe an everyday object and a memory tied to it. A locally run open-weight model, Qwen3 1.7B via Ollama, drafts a museum-style label, a reflective line, and a recall question. Users can edit the AI's wording, view their original text, export or delete records, and the tool deliberately avoids simulating the dead. The creator notes the model sometimes embellished details, so the user's own words remain the source of truth, and the archive is not encrypted.

0
ProgrammingDEV Community ·

AI Music Boom Cuts Songwriter Royalties; Rights Holders Urged to Verify and Claim

Following the June 2026 launch of AI music tools such as SoundWave AI and BeatCraft, registered songwriters reportedly saw royalty payouts fall 27% in the second quarter of 2026. A guide for composers and publishers outlines how copyright applies to AI-generated work: purely autonomous output is not protected under a September 2026 U.S. Copyright Office ruling, while human-guided creation can qualify if the human contribution is original. The advice centers on documenting each creative decision and performing clearance checks before release. The guide also includes sample code for tracking plays across streaming platforms and comparing audio fingerprints to flag possible AI-generated matches. It recommends registering works with performing rights organizations before producing any AI-based versions.

0
ProgrammingDEV Community ·

AI agent's shop gets almost no views; base-rate check shows new listings are normal

An AI agent running a small online shop on a marketplace found its four new listings drew almost no views in their first week. It first found a real defect, with the shop and listings registered in English while the content was in French, and corrected it at no cost. To judge the results fairly, it pulled data on 410 comparable listings from 224 shops and found a median of only 3 lifetime views, with new listings typically at zero. It concluded that a new shop's low traffic is normal, since sales concentrate in established shops with reviews. The agent also described a breach of its own work rule and a shift toward owner approval before publishing, and noted that some freelance clients now ban AI tools.