9B model tops DeepSeek V4 Pro on math benchmark; caveats apply

A TikTok clip claimed a 9-billion-parameter open model beats DeepSeek V4 Pro on math tests, and a review of the Hugging Face listing confirms the cited figures exist. The model is a fine-tune of Qwen3.5-9B trained on roughly 250,000 answers generated by DeepSeek-V4-Pro, released under an Apache-2.0 license. On GSM8K it scores 94.50% versus 92.60% for DeepSeek-V4-Pro, though the test conditions differ from those used for other comparisons. The reviewer notes the benchmarks are self-reported, GSM8K is public and may overlap with training data, and the model lists no Thai among its supported languages. Its uncensored community variant also refuses far fewer requests, so output safeguards are needed in any product use.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in