Ollama keep_alive on loaded model can stall requests for other models

·1 views

With OLLAMA_MAX_LOADED_MODELS set to 1, a request for an unloaded model prompts Ollama to schedule the currently loaded model for eviction once it goes idle. If a request for the loaded model arrives during this wait and includes keep_alive, that value overrides the pending unload, so the loaded model stays in memory for the full keep_alive period. Tests on Ollama 0.40.8 with CPU-only inference showed the second model responding in about 9 seconds without keep_alive but not within 150 seconds with keep_alive set to 30 minutes. The server reports no error and /api/ps looks healthy, and the relevant scheduler messages appear only at debug level. The issue is tracked upstream as ollama/ollama#19182, with a proposed fix in #19190.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Why AI Slop Is Harder to Detect Than Many Assume

An article argues that the term 'AI slop' is more slippery than it appears, since people often use it to mean anything they dislike rather than a clearly defined category. It notes that AI-generated text once had recognizable traits like stiff, formulaic phrasing, but modern language models can now mimic casual, professional, and personal writing styles convincingly. The author points out that generic, predictable writing predates generative AI, so surface features such as polished grammar or repetitive structure are weak evidence of machine authorship. The piece suggests that judgments about quality and authenticity are shaped by personal opinion and familiarity as much as by objective signals. It concludes that identifying AI content reliably requires looking beyond style to how we define quality and understanding.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Parallel coding agents can collide on one repo; kitchen habits offer a fix

Running several Claude Code or Codex sessions on the same repository often leads one agent to overwrite another's fixes, even though neither acted incorrectly. The article proposes borrowing three restaurant-kitchen practices: giving each session its own git worktree and branch, so conflicting edits surface as readable merges. It also suggests a shared claims.md file where each agent registers its task under a file lock to prevent duplicate work. Claims carry timestamps so that stale ones from crashed or closed sessions can be reclaimed after a set period. The author notes these rules live in instruction files that agents can skip, and that the approach works best for a solo developer, becoming harder to manage across several people and machines.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

LazyDesk: A Privacy-First Local AI Workspace for Focused Productivity

A developer has built LazyDesk (SlothAgent AI), a minimalist, local-first workspace for intentional productivity, submitted to the Hacktoberfest Open-Source AI Challenge. The app combines a glassmorphism dashboard with focus timers, task and note managers, and an optional AI chat assistant powered by open-weight models run through Ollama. All tasks, notes, and preferences are stored in the browser's localStorage, so personal data stays on the user's device. The project runs with a simple Python server and requires no npm installation or external cloud subscriptions. Its creator says the single workspace reduces context switching across separate timer, planning, note, and AI apps.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Computer Science Graduate Builds Career in SEO and Content Strategy

A computer science graduate describes how a technical degree led them into SEO and content strategy rather than software engineering. In 2015 they co-founded TechLookBD, which they ran alongside their work for about five years. Their undergraduate project, Autometify, was a touch-based home automation controller. They also held a senior executive role at AjkerDeal.com and an SEO analyst position at Web Integrator Ltd, a US-based agency that went remote in 2019. They now lead SEO strategy at TechLookBD and mentor SEO learners at Prayogik.com, arguing that the degree gave them a grounding in how websites work.

0 comments Read more at DEV Community