Fine-tune a 4B LLM into a fast classifier for under $5 using LoRA

A developer on DEV Community has outlined a method to convert Qwen 3.5, a compact 4-billion-parameter open-weights language model, into a rapid text classifier using LoRA fine-tuning. The approach targets common production tasks such as helpdesk ticket routing, user intent detection, and policy validation, where low latency matters more than generative ability. Training uses roughly 38,000 examples drawn from datasets like MultiNLI, BoolQ, and Banking77, supplemented with synthetic data, keeping costs surprisingly low. The model is prompted to return a single token answer from a fixed set of options, reducing output ambiguity and generation time. Serving is handled via vLLM, enabling response times in the hundreds of milliseconds once the endpoint is warm.