Open models match Claude on routine tasks but lag on hard reasoning, study finds

·2 views

QuickSilver Pro tested three open models, Kimi K3, GLM 5.3 and DeepSeek V4 Pro, against Claude Sonnet 5.5 and Opus 5.5 across 17 tasks run three times each. All three open models handled routine JSON extraction correctly, and Kimi K3 passed every standard coding task. On harder multi-step problems, however, the Claude models were perfect while the open models often failed, with the counting-out puzzle proving especially difficult. GLM 5.3 stood out as the only open model that was both cheaper than Sonnet 5.5 and as fast. DeepSeek V4 Pro also sometimes returned empty answers after exhausting its token budget on reasoning.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

PRINTFILM: open-source tool turns ideas into short AI-generated videos

PRINTFILM is an open-source platform that helps users create short videos and mini-series with artificial intelligence support. It works in stages, moving from text and scripts to storyboards, reference images, and finally video with audio. Users can pick from four non-realistic styles, including 3D animation, 2D anime, children's book illustration, and Chinese ink painting. The tool offers either AI-generated video or static images with narration and subtitles, and it lets creators save reusable characters, scenes, and objects to keep a consistent look. Deployment is mainly handled through Docker, with setup steps published in the project's official repository.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Adding Biometric Authentication to Flutter Apps with local_auth

A developer describes HerCycle, a privacy-first period tracker that keeps all data on the device and uses a PIN and biometric lock to protect it. The local_auth plugin, maintained by the Flutter team, adds fingerprint or face unlock by returning only a boolean for whether the user passed the check. Biometric matching happens inside the iOS Secure Enclave or Android's Trusted Execution Environment, so app code never receives biometric data. The guide notes that version 3 moved the biometricOnly flag into a direct parameter, breaking older snippets, and that setup on Android and iOS requires specific manifest permissions and a usage description. Because misconfigured setups often fail silently by returning false, the author stresses getting platform configuration right before writing Dart code.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Tutorial Shows How to Bulk-Search Text Inside PDFs Linked from a Web Page

A developer guide explains how to locate every PDF linked on a page, extract its text, and search it with page numbers using Python. It relies on the pypdf library and standard-library tools, and covers common obstacles such as scanned files, phrases split across lines, links that do not actually point to PDFs, and very large files. The author also presents a hosted bulk-extraction service that returns text, metadata, and search hits as JSON for use from Python or Node.js. The demo runs against the IRS Form W-9 page, which links to three PDFs, and finds mentions of backup withholding. The author discloses having built the hosted extractor used in the final section.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Guide Warns Against Silent Data Loss When Merging CSV Files

A technical guide explains why merging a folder of CSV files can go wrong even when the operation appears to succeed. It highlights encoding problems, since a CSV's character encoding depends on the exporting application, and recommends strict decoding rather than options that silently discard bytes. The article also covers byte-order marks and inconsistent column names, noting that differing headers can create separate columns or duplicate labels unless aliases are approved and checked. It further cautions that positional appending can misplace values when headers shift, and that label-aligned concatenation does not by itself enforce a schema. The piece closes with a Python workflow that rejects unexpected schema differences and avoids re-ingesting a previous output file.

0 comments Read more at DEV Community