OSLabs Releases Open-Source CLI PennyWyze to Audit Claude API Costs

·5 views

Three engineers at OSLabs have released PennyWyze, a free open-source command-line tool that helps developers find the cheapest Claude model tier that still meets their accuracy requirements. Users provide their production prompt and a labeled dataset of real examples, and the tool runs these against Claude's Opus, Sonnet, and Haiku tiers using the live Anthropic API. PennyWyze grades each model's responses against expected answers and calculates actual monthly cost projections based on real token counts. In one example audit, the tool identified that switching from Opus to Haiku could save roughly $180 per month with no loss in accuracy. Currently, PennyWyze supports exact-match grading, making it best suited for classification, extraction, and routing tasks rather than open-ended generation.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Over 1,500 AWS, Azure, and GCP Architecture Icons Now Available Free as SVGs

A developer has catalogued and made accessible 1,579 free SVG architecture icons spanning AWS (739), Microsoft Azure (626), Google Cloud (214), and Kubernetes (38) through a single platform called thesvg.org. The icons are sourced from each provider's official sets and carry their respective licenses — CC-BY-ND-2.0 for AWS, MIT for Azure, and Apache-2.0 for Google Cloud. A queryable JSON registry allows users to search icons by slug, title, or category without needing an API key, solving the common pain point of hunting across multiple zip archives. AWS icons follow a non-intuitive double-prefix naming convention — for example, the Lambda icon is 'aws-aws-lambda' rather than 'aws-lambda' — making the registry filter essential for accurate lookups. Notably, AWS icons carry a No Derivatives (ND) license, meaning modifications such as recoloring are not permitted under the terms of use.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

SAGA Pattern: Managing Distributed Transactions in Microservices Without 2PC

The SAGA design pattern breaks large distributed transactions into smaller, independent local transactions executed across multiple microservices. Each service handles its own transaction and, if a step fails, compensating actions are triggered to reverse previously completed operations. SAGA avoids the pitfalls of Two-Phase Commit (2PC), which is known for blocking resource locks and creating performance bottlenecks in high-throughput systems. The pattern supports two coordination models: orchestration, where a central coordinator directs each service, and choreography, where services communicate autonomously via events. While SAGA improves fault tolerance, scalability, and eliminates single points of failure, it introduces added system complexity and embraces eventual rather than immediate consistency.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AI Agents vs Agentic AI: Why Orchestration Is an Engineering Commitment

A growing body of research and industry guidance draws a clear distinction between a single AI agent — a component handling one scoped, verifiable task — and agentic AI, which is an orchestrated system of specialised agents with planning, memory, and task handoffs. OpenAI and Anthropic define the term 'agent' differently, and a 2026 academic survey confirms no standard definition yet exists across the field. Experts recommend starting with a single agent, scoring its performance, and only moving to multi-agent orchestration when evaluation data shows the workflow genuinely requires task decomposition or persistent memory. Gartner's June 2025 analysis warned that governance and cost — not model quality — are the primary reasons agentic projects fail. The practical takeaway is that orchestration adds complexity and new failure modes, and should be treated as a deliberate engineering decision rather than a default product choice.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Ooor: 1.5MB Open-Source Windows App Turns llama.cpp Into a Local AI Workstation

Ooor is a MIT-licensed, open-source Windows desktop application that packages the llama.cpp ecosystem into a lightweight, click-to-run local AI workstation. Developed by a contributor known as oshine and available on GitHub, the app compiles to just 1.5MB using WinForms and .NET Framework 4.8, idling in single-digit megabytes of RAM. It bundles an engine manager, a GGUF model library, a Hugging Face model marketplace, a resumable downloader, a streaming chat console, and an agent tool-calling layer in a single executable. Unlike alternatives such as LM Studio, which exceeds 500MB and relies on Electron, Ooor requires no cloud services, no user accounts, and collects no telemetry. The app exposes an OpenAI-compatible HTTP endpoint at 127.0.0.1:6080, allowing direct integration with tools like Cursor, Continue, and Cherry Studio.

0 comments Read more at DEV Community