Small 1.7B model fine-tuned with QLoRA rivals a larger 8B LLM at triaging Brazilian Portuguese reviews

A study tested whether a compact language model could sort thousands of free-text customer reviews into problem category, sentiment, and urgency as well as a much larger one. The researchers fine-tuned a Qwen3-1.7B model with QLoRA and compared it against a few-shot Qwen3-8B and a simple TF-IDF baseline, using real Brazilian Portuguese reviews from the Olist dataset. Performance was judged against 200 test reviews labeled by hand, with gold and silver labels kept separate to avoid misleading results. The fine-tuned small model matched the larger model on two of three fields, trailed it by about 4 accuracy points on sentiment, and ran 3.7 times faster in batch. The entire experiment was run on free Kaggle T4 GPUs, which the authors estimate would have cost roughly $1.30 at on-demand cloud prices.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in