Benchmark: LLM Gateway Delivers First AI Token ~35% Faster Than OpenRouter

·1 views

A controlled benchmark conducted on July 22, 2026, tested time-to-first-token (TTFT) latency across LLM Gateway and OpenRouter using Claude Haiku 4.5 with 75 cold and 75 warm runs each from a single machine. LLM Gateway recorded median cold and warm TTFTs of 906ms and 814ms respectively, compared to OpenRouter's 1392ms and 1232ms — roughly 34–35% slower. The open-source benchmarking tool used raw Python sockets to separately measure DNS, TCP, TLS, TTFB, and TTFT phases, helping isolate actual routing overhead from connection costs. Notably, OpenRouter's edge servers completed TLS handshakes faster (13ms vs 40ms), but lost significant ground after the request was dispatched, with its TTFB nearly matching its TTFT on every run. All 450 HTTP requests across both gateways returned HTTP 200 with zero errors, and the full per-run dataset has been published.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Docker-to-Kubernetes Image Workflow on Ubuntu Remains Unchanged Despite Runtime Shifts

Despite the removal of dockershim in 2022, the core workflow of building container images with Docker and deploying them on Kubernetes has not changed. Docker remains a reliable build tool, and Kubernetes continues to run OCI-compliant images regardless of whether the underlying node runtime is containerd or cri-dockerd. Best practices include using multi-stage Dockerfiles to minimize image size, tagging images with immutable version numbers instead of 'latest' to ensure reliable rollbacks, and configuring readiness probes to prevent traffic from reaching pods before the application is ready. Registry authentication must be explicitly configured via pull secrets, or pods will fail with an ImagePullBackOff error. Keeping the build tool, node runtime, and deployment manifests as distinct concerns allows developers to work without being affected by changes at the runtime layer.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Scrum Master Runs 3-Month Spec-Driven Dev Project Without Reading Code

A scrum master with a development background built a solo software project over three months using a spec-driven, AI-assisted workflow without directly reading the codebase. Instead of a separate task-management system, each ticket is stored as a YAML-fronted spec file that doubles as the design document, test contract, and backlog item. AI sub-agents implement and review code based solely on these spec files, with review dosage and model complexity calibrated per ticket's risk level. Lifecycle status transitions are enforced automatically via git hooks, preventing any manual or agent-driven shortcuts through the pipeline. The author presents this not as a universal methodology but as a working reference implementation others can adapt to their own projects.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Converts CMMC and NIST 800-171 Compliance Rules Into AI-Ready JSON

A developer built a Python pipeline that converts two major federal compliance frameworks — CMMC Level 1 and NIST SP 800-171 Rev 2 — from dense regulatory text into structured, machine-readable JSON rules. The pipeline pulls official source data, normalizes it into a SQLite schema, and attaches agent-guidance instructions designed to work directly as AI coding agent guardrails. The resulting dataset covers 125 controls across both frameworks and can also be integrated into CI/CD pipelines or GRC platforms. A key challenge during development was inconsistent data from NIST's export formats, including a silent bug caused by differing CVSS v2 and v3 JSON structures. The project aims to replace slow, manual compliance reviews with automated, AI-assisted checks for defense contractors and government-adjacent organizations.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer releases open-source GitHub Action to auto-detect broken links in docs

A developer has built urldn-link-check, an open-source GitHub Action and CLI tool designed to automatically scan Markdown documentation for broken links during continuous integration. The tool was created after the developer noticed that broken links in documentation often go unnoticed until users report them. It can be triggered on every push or pull request, catching issues before they are merged into production. Available under the MIT license, the project is published on both GitHub and npm and welcomes community contributions. It is the first tool in the broader URLDN open-source ecosystem, with more projects planned for the future.

0 comments Read more at DEV Community