SShortSingh.
Back to feed

tokeneff: Open-Source CLI Tool Tracks LLM API Costs Locally in Real Time

0
·1 views

Developers have released tokeneff, a free open-source command-line tool that monitors large language model API spending in real time without sending data to external servers. The tool runs a lightweight local proxy on localhost:7860, intercepting LLM responses to count tokens and calculate costs using a bundled pricing table stored in a local SQLite database. It supports multiple providers including OpenAI, Anthropic, DeepSeek, and GLM, and separately tracks spending in USD and CNY to avoid mixing costs across regions. A standout feature is its month-end spending forecast, which uses a weighted algorithm combining seven days of usage history and linear extrapolation to predict total monthly costs with a confidence score. API keys are stored in the OS keyring and prompt content is never logged, making it a privacy-focused alternative to cloud-based cost trackers.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

El Salvador Startup Uses Open Source Protocol to Cryptographically Seal Its Own IP

HormigasAIS, a sovereign edge computing company founded by Cristhiam Leonardo Hernández Quiñonez in San Miguel, El Salvador, has built a dual-layer technology model that blends open source and proprietary software. The company released its binary communication protocol, lbh-sdk, under the MPL 2.0 license, allowing public use and community contribution. Its enterprise layer — including master nodes, internal governance, and proprietary agents — remains private under a separate institutional license. In May 2026, the company authenticated its own logo using an HMAC-SHA256 cryptographic seal generated via its own protocol, bypassing traditional notarization. The model is designed to demonstrate that organizations can maintain digital sovereignty without relying on foreign technology platforms or third-party validation.

0
ProgrammingDEV Community ·

Check Point VPN Flaws CVE-2026-85102 and CVE-2026-85103 Face Imminent Mass Exploitation

Two critical vulnerabilities, CVE-2026-85102 and CVE-2026-85103, have been discovered in Check Point Security Gateway, Security Management Server, and Spark Firewall products, both carrying a CVSS score of 9.8. The flaws reside in VPN certificate processing and allow unauthenticated attackers to execute arbitrary code remotely without requiring any user interaction. The Dutch National Cyber Security Centre issued a warning on September 12, 2026, assessing the risk as high and predicting large-scale exploitation attempts are imminent, though no confirmed active exploitation has been reported yet. CVE-2026-85102 targets improper certificate validation during VPN negotiation, while CVE-2026-85103 involves a heap overflow in ASN.1 decoding, potentially compromising both gateways and management servers. Check Point has released patches, and organizations are urged to immediately identify affected devices, apply fixes, and monitor for anomalous VPN negotiation traffic or unexpected process crashes.

0
ProgrammingDEV Community ·

AI Trading System Uses NLP to Detect Hidden LLM Doubts Before Executing Crypto Trades

A developer building an AI-driven cryptocurrency trading system discovered that large language models can output confident structured decisions while their internal reasoning logs contain subtle hesitations and warnings. The team found that standard structured JSON outputs — such as a confidence score of 0.85 — mask critical contextual differences between a sound trade setup and a high-risk momentum chase. To address this blind spot, they built a component called the F-072 Semantic Risk Parser, which intercepts the LLM's unstructured chain-of-thought text and applies NLP and regex patterns to detect hidden risk signals. In one documented instance, the system identified such implicit warnings and blocked a leveraged long position on NEARUSDT moments before the market sharply reversed, preventing a significant portfolio loss. The approach highlights a broader challenge in algorithmic AI trading: relying solely on structured model outputs can create a false sense of certainty, while the model's own reasoning process may tell a more cautious story.