Open-source benchmark pits Kimi K3 against Claude models on real code quality

·1 views

Developers at Dsplce released an open-source benchmark this week to compare Kimi K3, Claude Fable 5, and Claude Opus 4.8 on practical code quality rather than leaderboard scores alone. The test challenged each model to make a double-entry ledger module production-ready, adding transaction reversal and statement generation features. A hidden test suite checked for genuine money-safety issues — including atomicity failures, floating-point drift, and an internal accessor leak — that the visible tests did not cover. All three models successfully fixed the atomicity bug, implemented the reversal feature, and patched the accessor leak across nine total runs. Differences in code quality and long-term maintainability only emerged on harder evaluation criteria, with the benchmark publicly available on GitHub for anyone to run.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

How Developers Can Access EU Open Banking APIs Without Costly eIDAS Certificates

Under the EU's PSD2 regulation, accessing bank APIs directly requires eIDAS-qualified certificates (QWAC and QSeal) that cost between EUR 2,000 and 10,000 per year and take weeks of regulatory paperwork to obtain. This makes direct bank API access impractical for independent developers, students, or small businesses. A compliant alternative exists through licensed Account Information Service aggregators, which hold the certificates themselves and expose a unified REST API to end users. Developers can sign up with such an aggregator using just an API key, gaining access to thousands of EU and EEA banks within minutes at little or no upfront cost. The trade-off involves routing data through a third-party intermediary, making it important to verify the provider's data residency policies and encryption practices before use.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

VIDRAFT Releases Fully Open-Source 6.59B MoE LLM with Five Attention Mechanisms

Seoul-based AI startup VIDRAFT has launched Aether-7B-5Attn, a 6.59-billion-parameter Mixture-of-Experts language model, on Hugging Face under the permissive Apache-2.0 license. Unlike many so-called open models, the release includes not only model weights but also training data recipes, full training code, hyperparameters, logs, intermediate checkpoints, and evaluation code for complete reproducibility. The model's core architectural innovation combines five distinct attention mechanisms — including full, differential, sliding window, sparse, and hybrid attention — distributed across 49 transformer layers using a 7×7 Latin Square layout to prevent depth-level imbalances. Trained on roughly 144.2 billion tokens with an intentional bilingual focus on Korean and English, the model activates only about 2.98 billion parameters per token, keeping inference costs relatively low. Both a base model and an instruction-tuned variant are available, along with a live demo hosted on Hugging Face.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

DBOS Refreshes Onboarding Experience to Highlight Key Platform Features

DBOS has updated its introductory experience to give new and existing users a consolidated overview of its core capabilities. The refreshed five-minute walkthrough covers workflows, schedules, queues, workflow communication, and DBOS Conductor. A new starter app is also available in multiple programming languages via the official quickstart documentation. The update was prompted by the team's observation that even active production users were often unaware of the platform's full feature set.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Cartagena Engineer Builds AI-Focused Developer Community Through GDG Colombia

A software engineer based in Cartagena, Colombia, is working to grow a local tech community through GDG Cartagena, bringing together developers, students, and technology enthusiasts. The initiative focuses on areas including artificial intelligence, cloud computing, and open-source tools. The engineer believes that innovation is not limited to major tech hubs, and that local communities can engage with global technologies and create meaningful impact. Community activities such as meetups, workshops, and hackathons are used to help participants discover new technologies and expand their professional networks. The effort reflects a broader view that technology development is as much about human collaboration as it is about technical skills.

0 comments Read more at DEV Community