Qwen3 4B Matches Qwen2.5 7B on Writing Correction While Running 2x Faster

A developer benchmarked three locally hosted Qwen language models — Qwen2.5 7B, Qwen3 4B, and Qwen3 8B — on a 20-case writing correction task using Ollama on Windows, generating 60 total responses. Both Qwen2.5 7B and Qwen3 4B achieved identical results, each completing 18 out of 20 cases correctly and failing on the exact same two cases. Qwen3 8B performed marginally better, completing 19 out of 20 cases. The most striking finding was in execution speed: Qwen3 4B averaged 23.99 seconds per cold-start run, compared to 54.37 seconds for Qwen2.5 7B, making it roughly 2.27 times faster. The experiment suggests that for this specific writing-correction benchmark, the newer smaller model can match the practical output of its larger predecessor at significantly lower latency.