Developer Tests Local AI Models Qwen and ModernBERT as Low-Cost Alternatives to OpenAI

A developer running a self-hosted RSS reader called RSSMonster began exploring local small language models after OpenAI API costs climbed to around €10 per month. To reduce expenses, they integrated two locally run models — Qwen, an Alibaba-developed embedding and language model, and ModernBERT, a classification-focused encoder — to handle tasks like summarization, tagging, and content quality scoring. Both models passed the project's existing semantic regression tests, though they produced noticeably different clustering and topic-assignment results compared to OpenAI's outputs. Qwen assigned more articles to events and topics than OpenAI, while ModernBERT handled classification tasks such as detecting promotional content and emotional tone. The experiment suggests that small language models running on common hardware can serve as viable, cost-effective alternatives for semantic features in personal or self-hosted projects.