Qwen2.5-Coder Edges DeepSeek-Coder in Local Solidity Security Reviews at 7B Scale
A developer tested Qwen2.5-Coder and DeepSeek-Coder locally via Ollama on WSL2, running both 7B-and-below models against ten small Solidity contracts containing deliberately planted security bugs. Each contract was evaluated using three prompt types — open-ended, targeted, and structured — with results scored manually on bug detection, accuracy, and output noise. Qwen2.5-Coder showed a clear advantage in instruction-following, consistently respecting structured output formats critical for automated pipelines. While DeepSeek-Coder matched Qwen on detecting classic vulnerabilities, it more frequently drifted off-topic and produced generic explanations rather than specific attack sequences. The author notes the comparison was motivated by model selection for an open-source auditing tool and cautions that neither model is suited for large, real-world contract audits.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in