DeepSeek V4.1 Flash 1017 outscored its September release on two agentic coding benchmarks

DeepSeek released V4.1 Flash 1017 on October 17, describing it as a minor update, and it kept the same API name and pricing. On two agentic coding benchmarks it beat the September V4.1 Flash release, scoring 0.6957 versus 0.591 on one and a 0.4520 median versus 0.3342 on the other. The two builds of the same app from this model scored 0.2422 and 0.6618, with the lower one stalling on a rate-limit wait loop. The results come from a single task per benchmark in one specific test setup, so they are indicative rather than conclusive. The same report also covered weaker results from NVIDIA's Nemotron 3.5 Super VL and a local Muse Glimmer 30B model, along with corrections to how the test platform recorded costs.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in