Hidden Costs of AI APIs: Tokenization, Caching, and Retries Can Inflate Bills

·3 views

A developer building a document summarization tool projected about $40 in monthly API costs but received a bill of roughly $312. The article attributes the gap to tokenization, since technical terms can consume several tokens each, often inflating counts 30-60% above word-based estimates. It also explains that cached-input discounts apply only to byte-identical prompt prefixes, so small dynamic additions like timestamps can wipe out savings. Longer context can degrade output quality, pushing developers toward chunking and extra API calls, while rate limits add retry overhead that costs money even without a successful response.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Daily peanut snacking linked to better memory-related brain function in older adults

A study reported by ScienceDaily found that about two servings of unsalted, skin-on roasted peanuts per day for 16 weeks may support brain health and memory in older adults. Researchers observed improved insulin response in brain regions important for memory, a function that often weakens with age and has been associated with Alzheimer's disease. The article stresses that the study concerns memory and brain metabolism, not vision or amblyopia, and is not a reason to change diet. It uses the finding to illustrate how the adult brain remains adaptable when exposed to a modest stimulus regularly, and separately discusses how visual training works on the same principle of brain plasticity.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Email Deliverability Checklist for Developers: SPF, DKIM, DMARC and Warm-Up

The article offers a practical guide for developers who send email, whether transactional, marketing, or cold outreach, on getting messages into recipients' inboxes. It explains how SPF lists authorized sending servers in DNS, how DKIM adds a cryptographic signature to verify messages were not altered, and how DMARC combines both and sets a policy for failed checks, recommending starting with monitoring. It also advises gradually warming up new domains or IPs to avoid spam flags, and processing bounces and complaints, removing hard-bounced addresses promptly. Finally, it recommends content practices such as avoiding spam-like phrasing and including plain-text versions and unsubscribe links, plus free tools for monitoring reputation.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Health Form Bug Mislabeled a 190 lb User as Obese Due to Unit Input Errors

A developer's corporate wellness health-check form wrongly classified a tester weighing 190 lb and standing 5'11" as obese, when the correct BMI is about 26.5, which is overweight. The discrepancy traced back to input handling rather than the formula itself: a height field expecting centimeters accepted values like 1.75 and produced absurd results, while an imperial field accepted feet entered as a decimal (5.11 instead of 5 feet 11 inches). The fix involved rejecting implausible heights and replacing the decimal input with separate integer fields for feet and inches. The developer said the corrected form now matches reference calculations for test cases.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Investigation Uncovers Hidden Installer Scripts in Roblox Toolbox R6 Models

A developer investigating suspicious R6 character models in the Roblox Toolbox found a hidden script and a nested object hierarchy inside a character's arm. The author reports that similar structures appeared across multiple assets, sometimes from different creators. Code analysis showed the script installs a hidden interface into the player's GUI, renames several components, and only runs while in Roblox Studio. A companion client script reportedly displays a technical-sounding notification and a copyable code snippet, which may be an attempt at social engineering to get developers to run an external command. The investigation was ongoing, and the author had not yet confirmed that a malicious remote module was actually executed.

0 comments Read more at DEV Community