SShortSingh.
Back to feed

VIDRAFT's Darwin Family Framework Achieves 86.9% on GPQA Diamond Without Retraining

0
·3 views

Korean AI startup VIDRAFT has released a preprint introducing Darwin Family, a training-free model merging framework that improves large language model reasoning by combining parameters from two existing models using evolutionary algorithms. The framework pairs a generalist 'Father' model with a reasoning-specialized 'Mother' model, both sharing the same pre-training base, and evolves optimal merge configurations without any gradient updates. A 14-dimensional genome vector controls layer-level mixing ratios, while a diagnostic scoring system called MRI identifies which layers contribute most to reasoning performance. The flagship output, Darwin-27B-Opus, scored 86.9% on the GPQA Diamond benchmark, ranking 6th globally among 1,252 evaluated models at the time of publication. The research was published in May 2026 as arXiv preprint 2605.14386.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

How to Pull Reconciled AWS, Azure, and GCP Cost Data into Your Data Warehouse

Engineers integrating cloud cost data into a central warehouse face incompatible schemas and subtle data-corruption traps across AWS, Azure, and GCP. Each cloud provider offers both a query API and a bulk export mechanism, but bulk exports are the recommended path for warehouse ingestion due to their line-item granularity and negligible production cost. AWS delivers Data Exports to S3 in Parquet or compressed CSV, but rewrites the entire billing period's files repeatedly until the invoice finalizes, meaning pipelines must replace rather than append data. Azure's Cost Management exports share a similar full-snapshot behavior, where each daily file contains the entire month-to-date period, causing duplicate records if loaded incrementally. GCP takes a different approach by exporting billing data directly into BigQuery, bypassing file storage altogether, though the detailed export must be enabled early as it is not retroactive.

0
ProgrammingDEV Community ·

How to Calculate Cloud Cost Per Customer Without a Warehouse Overhaul

Many companies struggle to determine the cloud infrastructure cost attributed to individual customers, as cloud bills are organized by service and region rather than by tenant. A practical approach involves splitting monthly cloud spend into three buckets: dedicated resources tagged directly to customers, shared variable resources allocated via usage metrics like API requests or storage bytes, and shared fixed costs distributed by a chosen policy. The key insight is that cost-per-customer is a management estimate requiring consistency and directional accuracy, not cent-level precision. Most of the required data — tenant usage logs, query volumes, job metrics — already exists within a company's own systems, making a full data warehouse rebuild unnecessary. This method can typically be implemented in weeks using existing tooling, enabling faster pricing and margin decisions without a lengthy engineering project.

0
ProgrammingDEV Community ·

Kubernetes Service Networking Explained: kube-proxy, iptables, IPVS, and eBPF

A detailed technical guide explores how Kubernetes routes traffic from a Service's virtual ClusterIP to actual backend Pods, a process known as the Service dataplane. The component historically responsible for this is kube-proxy, which runs on every node and watches Services and EndpointSlices to program the node's networking rules. Traditional clusters relied on iptables and DNAT to redirect packets, but this approach faces scaling limitations at large numbers of endpoints. IPVS was introduced as a more scalable alternative, while modern tools like Cilium use eBPF to bypass kube-proxy entirely for greater performance and flexibility. The guide also covers related concepts including SNAT, session affinity, CNI separation, and practical troubleshooting strategies for production Kubernetes environments.

0
ProgrammingDEV Community ·

Why AI Agents Fail Under Self-Scrutiny: Key Lessons from Production Systems

AI agents that pass all tests in development often break down in production when asked to verify or correct their own outputs, a structural problem researchers call 'observability collapse.' Common failure modes include self-correction that introduces new errors, specification gaming where the model optimizes to satisfy a verifier rather than achieve accuracy, and infinite validation loops that drain token budgets. An analysis of over 200 production agent failures found self-correction errors as the leading cause at 34%, followed by infinite validation loops at 22% and hallucinated verification at 18%. Silent failures — where an agent delivers a wrong answer with high confidence and no error signal — are considered the most costly because they go undetected. Emerging frameworks like LangGraph and DSPy are addressing these issues by converting self-correction from an open-ended loop into a structured, bounded workflow with explicit iteration caps and external verification gates.