SShortSingh.
Back to feed

Silent Docker deploys served stale builds for hours before anyone noticed

0
·1 views

A development team discovered on 2026-08-27 that two separate deployment workflows were silently running outdated software without raising any errors or alerts. The first issue stemmed from hot-patching files directly into a running container, a practice that works until a container is recreated and reverts to the original image with no warning. The second problem involved a rebuilt image that was missing one of 20 expected supervisord processes — specifically the certificate-expiry watcher — leaving custom domain SSL monitoring effectively blind. In both cases, standard Docker inspection tools like docker ps and health checks appeared normal, masking the discrepancy entirely. The team responded by adding explicit labeling to dev-loop scripts, building a preflight tool to diff running processes against config, and creating a drift-detection command with a distinct 'unmeasured' exit state to prevent silent false positives.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Nearly 15,000 Kubernetes Dashboards Found Publicly Exposed on the Internet

A ZoomEye search using the query title="Kubernetes Dashboard" returned 14,913 matches on September 23, 2026, revealing thousands of Kubernetes administrative interfaces reachable from the public internet. Unlike standard web applications, these dashboards are designed to manage workloads and can allow users to list pods, read secrets, and execute commands inside containers, making unintended exposure particularly risky. Such exposures often occur accidentally through misconfigurations like changing a service type to LoadBalancer or setting up an incorrect ingress rule. Security researchers note that even a single exposed dashboard with weak access controls can pose greater risk than thousands of exposed static websites. Recommended mitigations include treating management interfaces as internal-only by default, enforcing VPN or authenticated proxy access, disabling skip-login options, and using external scanning tools to audit your own address space for inadvertent exposure.

0
ProgrammingDEV Community ·

Why AI Coding Agents Lose Track Mid-Task and What One Tool Aims to Do About It

AI coding agents often appear to "forget" progress during long debugging sessions, but the root cause may be context pollution rather than model capability limits. As agents accumulate logs, stack traces, old errors, and completed investigation steps, the context window fills with outdated and irrelevant information. Even large context windows do not solve the problem if the content inside them is too noisy to be actionable. A developer has built an experimental tool called Tokenectomy that preprocesses environment output before passing it to the agent, filtering out noise while preserving relevant state. The goal is not to improve the underlying model but to ensure the information the agent receives is cleaner, more focused, and better suited to the current task.

0
ProgrammingDEV Community ·

Audit of 110 AI billing tools uncovers 45+ bugs, including 99% usage under-reporting

A month-long audit of 110 open-source AI tools used for token counting, cost tracking, and budget enforcement uncovered more than 45 verified bugs across five recurring categories. The most critical finding, independently confirmed by an external auditor, revealed a cache-accounting flaw that under-reported actual usage by roughly 99% on affected code paths. Common issues included stale pricing tables, incorrect cache-read multipliers applied across providers, retry double-counting in stream aggregation, and quota window boundary errors. So far, 23 fixes have been merged into upstream projects, including widely used tools like Langfuse and Codeburn. A separate check of 20 commercial AI vendors found that none published any formal process for disputing or correcting metering errors.

0
ProgrammingDEV Community ·

New tool aims to make AI agent binary decisions testable and auditable

A developer has identified a core reliability problem in AI agent workflows: when an agent is asked to choose between two options inside a prompt, the decision cannot be logged, tested, or distinguished from a random pick. To address this, they built a dedicated decision tool that isolates the judgment into a separate API call, returning a chosen option, a confidence score, and a reason. The confidence score reflects how far apart the two options were rated, rather than how certain the model sounds about its own answer — a distinction the author argues is critical for building automated gates. Teams can set their own confidence thresholds to either accept a pick automatically or escalate to a human, depending on the cost of a wrong decision. A public MCP server is available for testing the tool, with self-service credentials and machine-readable error codes designed to let agents handle failures programmatically.