Self-Hosting LibreChat Cuts Team AI Costs by Replacing Per-Seat Fees with Token Billing

·1 views

LibreChat is an open-source, ChatGPT-style interface that allows teams to access multiple AI models—including OpenAI, Anthropic, and Google—through a single self-hosted instance. Instead of paying $20 per user per month as with ChatGPT Plus, teams are billed only for the tokens they actually consume via provider APIs. A five-person team could reduce monthly AI costs from around $100 in seat fees to roughly $10–30 in combined hosting and API usage. The platform supports multi-user authentication, agents, file chat, and a code interpreter, but requires proper setup including a reverse proxy, TLS, secure JWT secrets, and restricted signups to avoid security and cost risks. Deploying a production-ready instance realistically takes one to two hours, and MongoDB must be kept persistent to preserve team conversation history.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Google Launches Gemini 3.8 Flash: Smarter Reasoning at the Same Price as 3.7

Google released Gemini 3.8 Flash on September 2, 2026, just three weeks after Gemini 3.7 Flash and six weeks after 3.6 Flash. The new model retains identical pricing at $0.75 per million input tokens and $3.75 per million output tokens through December 31, 2026, after which both models rise to $1.50 and $7.50 respectively. Key improvements are internal: 3.8 Flash uses smaller reasoning steps, self-checks its outputs, and runs tools iteratively, resulting in a higher Artificial Analysis Intelligence Index score of 59 versus 56 for 3.7 Flash. However, these enhancements come at the cost of more tokens consumed per task, meaning per-task expenses may increase despite unchanged per-token rates. Google confirmed that Gemini 3.7 Flash remains fully supported with no deprecation date, so developers are not required to migrate immediately.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Google Launches Gemini 3.8 Flash: Smarter Reasoning but Migration Not Urgent

Google released Gemini 3.8 Flash on September 2, 2026, just three weeks after Gemini 3.7 Flash, positioning it as its most capable Flash model to date. The new model features shorter reasoning steps, iterative tool calls, and self-verification during execution, resulting in modest benchmark improvements over its predecessor. Pricing remains identical at $0.75 per million input tokens and $3.75 per million output tokens through December 31, 2026, with the same one-million-token context window and comparable output speed. However, the improved reasoning can consume more tokens per task, meaning quality gains may come with higher costs depending on workload. Google confirmed that Gemini 3.7 Flash remains fully supported with no deprecation date announced, making an immediate upgrade unnecessary.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AWS Secrets Manager vs Parameter Store: How to Choose the Right Tool

AWS offers two primary secrets and configuration storage services — Secrets Manager and Systems Manager Parameter Store — both backed by KMS encryption, but suited to different use cases. Secrets Manager is purpose-built for sensitive credentials that require automatic rotation, cross-region replication, and cross-account sharing, at a cost of around $0.40 per secret per month. Parameter Store is a general-purpose hierarchical config store with a free standard tier, making it better suited for application configuration, feature flags, and static secrets that rarely change. The core decision rule is straightforward: if a secret needs to rotate on a schedule, use Secrets Manager; otherwise, Parameter Store is the more cost-effective choice. Choosing the wrong service at the start of a project can lead to expensive rewrites or unnecessary costs, making the upfront decision critical.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Gemini 2.5 Flash Drops 'Minimal' Thinking Level, Defaults to Medium Not High

Google's Gemini 2.5 Flash introduces three thinking levels — low, medium, and high — which control how much internal reasoning the model performs before responding, directly affecting latency, token output, and cost. Unlike its predecessor Gemini 2.0 Flash, the new model no longer supports the 'minimal' thinking level; any API request using that value will fail at validation before any tokens are generated. The default thinking level is medium, not high — a key difference from Gemini 2.0 Pro, which defaults to high, meaning teams migrating between models may get unexpected behavior if they don't set the parameter explicitly. Thinking tokens, generated during the model's internal reasoning process, are billed as output tokens at $3.75 per million until end of 2026, rising to $7.50 per million from January 2027. Google recommends explicitly setting the thinking level in every API request and storing it in a central config file to avoid unintended cost or behavior changes when defaults shift.

0 comments Read more at DEV Community