Eight AI Gateways Compared: Features, Pricing, and Self-Hosting Options

·2 views

A technical evaluation published on DEV Community reviewed eight AI gateway platforms across criteria including provider coverage, pricing transparency, self-hosting capability, and observability tools. AI gateways serve as intermediaries that route requests to large language model providers, helping developers manage multiple API keys, control costs, and handle provider outages from a single endpoint. LLM Gateway was rated best overall for being fully open-source, supporting 200-plus models across 40-plus providers, and charging no markup when users bring their own API keys. OpenRouter was highlighted for its large community-driven model catalog but noted for its 5.5 percent credit-purchase fee and lack of self-hosting support. Portkey was identified as enterprise-focused with strong observability and compliance features, though it was acquired by Palo Alto Networks in May 2026, which may influence vendor-independence considerations.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

AI Coding Tools Boost Developer Speed but Cannot Replace Human Judgment

AI coding tools can generate functions, fix bugs, and build prototypes faster than ever, but speed alone does not ensure that the output is correct, secure, or suitable for a given system. A paper examining whether AI replaces or assists software developers concluded that augmentation — not replacement — best describes the current reality. While AI may reduce the demand for some entry-level coding tasks, core developer responsibilities such as understanding requirements, designing systems, and making tradeoffs remain deeply human. The developer's role is expected to shift rather than disappear, with judgment — knowing when to use, edit, or discard AI-generated code — becoming more critical than before. As AI handles more first drafts, the higher-order thinking that shapes what gets built and why grows in importance.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AI Agents Remove the Informal Human Safety Net That Caught Bad Requirements

A software development commentary argues that when developers received vague or flawed sprint requirements, their natural confusion prompted them to walk over to a colleague's desk mid-implementation and ask clarifying questions — an undocumented but effective error-catching mechanism. This informal habit routinely surfaced planning failures early in a sprint, before flawed assumptions could reach production. AI coding agents lack this behavior: they either proceed on their best interpretation of an ambiguous spec or halt entirely, skipping the organic peer consultation that humans relied on. While modern AI tools do ask clarifying questions, the author contends these are directed back at the same person who wrote the prompt, rather than reaching colleagues who may hold missing context. The result is a genuinely new failure mode where bad requirements that once got caught mid-sprint now flow unchecked all the way to production.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

LLM Judges Give Inconsistent Scores on Identical Inputs, Undermining CI Gates

A software developer discovered that an LLM-based quality gate on their merge pipeline returned different scores — 0.79, 0.82, and 0.80 — across three identical runs with no code or prompt changes. The inconsistency stemmed from four main causes: non-zero sampling temperature, floating model version aliases, vague scoring rubrics, and noise at tie-breaking boundaries. When gates behave this way, developers learn to re-run jobs until they pass, effectively turning a quality check into a lottery. The author resolved the issue by setting temperature to zero, pinning exact model snapshots, averaging scores across multiple judge calls, and quantizing scores to a coarse grid. The broader fix recommended is to treat LLM judge scores as distributions rather than ground truth, only failing a gate when the mean falls below the threshold by more than the measured noise margin.

0 comments Read more at DEV Community

ProgrammingGitHub Blog ·

GitHub Reports Six Service Incidents Causing Degraded Performance in June 2026

GitHub published its availability report for June 2026, disclosing six incidents that affected its services during the month. Each incident resulted in degraded performance across various GitHub platforms. The report is part of GitHub's ongoing practice of transparently communicating service disruptions to its users. No further details about the specific nature or duration of each incident were provided in the summary.

0 comments Read more at GitHub Blog