Compressed 27B AI model outperforms full version on function calling benchmark
Underdog Research released a 7.89 GB compressed version of the Qwen3.8-27B AI model called Saluki 27B. The compressed model scored 88 out of 120 on the team's proprietary function calling test suite in October 2026, while the original 54 GB model scored 84. Saluki uses a mixed 2-bit quantization technique and runs on standard llama.cpp without special builds. The creators note that while Saluki excels in single and multi-choice function selection, its mathematical performance declined by 15-18%.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in