FreeLLMAPI Pools Free Tiers of 34 AI Providers Behind One Self-Hosted Endpoint

·6 views

FreeLLMAPI is a self-hosted router that combines the free tiers of 34 AI providers behind a single OpenAI-compatible endpoint, which the project says adds up to roughly 7.4 billion tokens per month. It automatically selects the best available model for each request and fails over to another provider when one is rate-limited or returns an error. The tool tracks per-key rate limits to stay within each provider's free-tier caps and supports a range of API surfaces, including chat, image, audio, embeddings, Anthropic and Gemini formats. Developers can connect coding assistants such as Claude Code and Codex CLI through a single setup command. The project is written in TypeScript, released under the MIT license, and has around 50,000 GitHub stars.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Netherlands Reportedly Negotiating Dismantling of the International Criminal Court

A report from Rights Forum cites diplomatic sources claiming the Netherlands is negotiating the dismantling of the International Criminal Court. The claim comes from anonymous sources and has not been confirmed by official statements in the available material. The item was shared on Hacker News, where it drew modest attention with 51 points and 2 comments. The available text does not detail the specific proposals, timeline, or reasons behind the reported negotiations. Readers should treat the claim as unverified until corroborated by official or independent reporting.

0 comments Read more at Hacker News

ProgrammingDEV Community ·

Centralized Command-Sourced Document Design Avoids CRDTs, Trading Convergence for Strict Ordering

A developer write-up argues for a centralized, command-sourced collaborative document system that drops conflict-free replicated data types in favor of a single authority enforcing transactional ordering. It warns that treating multiple windows of one document as independent file writers causes OS file-lock contention, write failures, and journal corruption. The recommended fix is a master-sidecar design where one local authority process owns the journal and other windows connect as zero-write IPC clients. To avoid slow late-joiner synchronization from replaying an unbounded journal, the author proposes periodic snapshot checkpoints that truncate the log. The article also cautions that naive client-side rebase rules break down for hierarchical document structures.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

nRouter releases SDKs across multiple languages sharing one API key and endpoint

nRouter has published official software development kits for Python, TypeScript, Go, Rust, Java/Kotlin, Swift, Dart and R, each installable through its ecosystem's package registry. All of them read the same NROUTER_API_KEY environment variable and connect to one endpoint, so access can be issued, rotated and revoked from a single place. The company's pitch is that cost tracking, guardrails and fallback routing run on the server side, keeping behavior consistent across languages. Existing OpenAI and Anthropic clients can also be pointed at the gateway through a configuration change. The author, who works at nRouter and disclosed AI assistance in drafting the post, invited readers to share how they manage credentials across polyglot stacks.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Crunchy Bridge vs ClickHouse Managed Postgres for AI Agent Backends

A comparison guide examines ClickHouse Managed Postgres and Crunchy Bridge as databases for AI agent applications, focusing on transactional performance, retrieval, tooling, and development workflows. It also addresses storage and scaling, availability, recovery, pricing, analytics integration, and migration. According to the guide, ClickHouse Managed Postgres suits workloads needing fast throughput on local NVMe storage, integrated operational tooling, or a path into ClickHouse analytics. Crunchy Bridge is presented as the better fit when independent storage sizing, broad PostgreSQL extension support, or multi-cloud deployment is required. The guide notes that ClickHouse's acquisition of Xata is intended to add scale-to-zero and copy-on-write branching to its service.

0 comments Read more at DEV Community