SShortSingh.
Back to feed

AI coding agent Empryo outspends pi on cost using Opus 5 in four-bug benchmark

0
·3 views

Developer and Empryo creator published a benchmark on 16 August 2026 comparing two AI coding agents, Empryo and pi, on their ability to fix four bugs sourced from the hono and opencode repositories. Both agents successfully resolved all four bugs when running on the Opus 5 model, making cost the key differentiator in this comparison. Empryo completed the round at a total cost of $2.27 versus pi's $3.10, though pi was cheaper on one individual task involving a cookie-mangling bug. The author notes the benchmark used a limited number of attempts per task and compared specific configurations — Empryo with 37 tools and a code map, pi with four tools — so results may not reflect all possible setups. A broader report covering six models acknowledges that pi can still be the cheaper option on less expensive models.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Laravel Context: How to Share Execution Data Across Requests, Logs, and Jobs

Laravel's Context feature allows developers to store and retrieve information — such as trace IDs, tenant IDs, or URLs — that needs to persist throughout a single application execution without being passed explicitly between methods. The data can be added via Context::add() and accessed anywhere in the application using Context::get(), making it especially useful for consistent log enrichment. When a queued job is dispatched, Laravel automatically captures the current context, serializes it into the job payload, and restores it when the worker processes the job — a process called dehydration and hydration. This ensures that contextual data from an originating HTTP request, like a trace ID, remains accessible inside the job for debugging distributed workflows. Importantly, Laravel isolates context per job execution, preventing data from one job from leaking into the next in long-running queue workers.

0
ProgrammingDEV Community ·

Dev Team Builds AI Coding Agent With Persistent Memory Across Sessions

A development team grew frustrated with AI coding assistants that lose all project context at the end of each session, forcing developers to re-explain architecture and previously solved bugs every time. To solve this, they built a web agent with a lightweight, persistent memory layer that reads and updates project knowledge as it works. The system stores architectural decisions, past bug fixes, coding conventions, and feature progress in structured, human-readable Markdown files rather than a complex vector database. Built using React, Next.js, Node.js, and an LLM-based coding layer, the agent checks its memory before attempting solutions, enabling consistent and informed responses across sessions. The team reports the key improvement was not smarter code generation but better continuity, making the agent behave more like a long-tenured teammate than a stateless tool.

0
ProgrammingDEV Community ·

Developer ditches tutorial hoarding for small project-based learning

A developer shared on DEV Community how they shifted away from endlessly collecting tutorials toward a more hands-on learning loop. The new approach involves learning one concept, building something small with it, and working through problems as they arise rather than seeking complete mastery upfront. Getting stuck and debugging is now treated as a core part of the process rather than a setback to avoid. This method produces tangible outputs instead of folders full of saved but unused resources. The developer is still experimenting with the approach and invited others to share what helped them bridge the gap between understanding tutorials and independently building projects.

0
ProgrammingDEV Community ·

CS Student Shubham Shah Builds Real-World Systems to Master Software Engineering

Shubham Shah, a Computer Science Engineering student, began programming in Grade 8 and has since developed a hands-on approach to learning by building functional projects rather than following tutorials. His most significant project, Hostello, is a hostel management platform designed to replace manual registers and spreadsheets with a full-featured digital system. The platform incorporates role-based access control, real-time communication, QR-based identification, and multi-building management, among other capabilities. Building Hostello shifted Shah's understanding of software from simple code-writing to tackling production-level concerns like security, scalability, and system maintenance. Beyond development, he holds a strong interest in Linux internals and infrastructure, working with tools such as Docker, reverse proxies, and server administration across a broad technology stack.