osFoundry keeps a warm, cache-friendly Claude Code session across channel messages

·1 views

The article describes how osFoundry handles repeated mentions of a resident Claude Code session in a Message channel without re-sending everything each time. Only the newest user turn is sent to an already-running process, while the system framing is placed once at the start so the prompt-caching prefix stays stable. A resident process is kept per channel and binding, capped at four at a time, and shut down after 30 minutes of inactivity. The author notes that three omissions keep long-running sessions economical: no repeated system prompt, no replay of prior turns, and no channel lines the session has already seen. The piece also includes a simulation measuring the savings from these choices.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Developer builds Firecracker-based agent sandbox and benchmarks it against Google's design

A developer published a write-up describing their own implementation of an isolated sandbox for AI agents, built on Firecracker microVMs. The project was a response to a sandbox architecture that Google had described publicly. The author measured the performance of their build rather than relying on theoretical claims. The post was shared on Hacker News, where it gathered 8 points and no comments at the time of capture. The full write-up is available on the author's personal blog.

0 comments Read more at Hacker News

ProgrammingDEV Community ·

OpenAI's always-on 'Dots' agents raise privacy and compute cost concerns

At its DevDay event on September 29, OpenAI introduced Dots, agents that run continuously in the cloud, each with its own computer and browser, and connect to many apps through plugins. Users can control when the agent acts alone or asks first, and sensitive actions such as changing passwords remain with the user. Critics such as Signal president Meredith Whittaker argue that deep access to personal data creates privacy and security risks, including exposure of third parties who never consented to an AI reading their messages. Because always-on agents are computationally expensive, OpenAI is also routing some work to a smaller, cheaper model, while companies report AI spending well above their budgets. Experts suggest granting access gradually and treating agent permissions as an architecture decision involving least privilege and cost controls.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Rate limiting Minimal APIs in .NET with the built-in middleware

Public APIs are exposed to clients that may flood an endpoint with requests, whether from a bug, a faulty script or deliberate abuse. Since .NET 7, the framework includes rate limiting middleware, so no third-party package is needed. The article demonstrates a per-IP fixed-window policy that rejects excess requests immediately with a 429 status and a Retry-After header. It also covers applying the policy to specific endpoints, keeping health checks unlimited, and writing integration tests with WebApplicationFactory.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

DejaVu: AI incident agent uses long-term memory to recall past outage fixes

An engineer describes building DejaVu, an AI on-call agent designed to remember every outage a team has resolved. The author argues that most incidents are recurring failure patterns that appear under different service names and error messages, and that general chatbots lack the context to recognize them. DejaVu works through a recall, reason, and retain loop, using the Hindsight open-source memory system to retrieve semantically similar past incidents and feed them to an LLM. In a side-by-side test, the same model reported 20% confidence without memory versus 98% with memory for a simulated cache bug. The author notes that a keyword search would miss many of the 6 cache-related incidents in a 20-incident dataset, which semantic recall can surface.

0 comments Read more at DEV Community