SShortSingh.

Programming

0
ProgrammingDEV Community ·

How a Simple YAML File Can Make AI Prompts Maintainable and Operational

A developer on DEV Community argues that storing AI prompts as plain string constants makes them difficult to maintain over time, especially as team ownership changes. The proposed solution is a structured YAML metadata file kept alongside each prompt in the same code repository, capturing details such as inputs, output schemas, model parameters, costs, and dependencies. A key component of this approach is a 'fails_when' section, where the original prompt author documents specific measurable signals, numeric thresholds, and first-response actions to guide on-call engineers during incidents. The author emphasizes that this institutional knowledge — such as which metric degrades first or whether a failure stems from a model change rather than the prompt itself — typically decays within weeks if not recorded. The article estimates the setup takes roughly twenty minutes per prompt and frames the recipe file as an operational artefact rather than mere documentation.

0
ProgrammingDEV Community ·

Prompt Engineering in 2026: What Actually Works and Why Most Tricks Faded

A technical analysis published on DEV Community argues that most early prompt engineering tricks failed because they added no real information to the model's context, only attempted to nudge its behavior. The author divides prompting techniques into two categories: 'information,' which supplies facts the model cannot infer, and 'elicitation,' which tries to coax better behavior from knowledge the model already has. Elicitation phrases like 'be thorough' or 'you are an expert' were useful against older models but have become redundant as instruction tuning improved and careful responses became the default. Techniques that still hold up include providing specific contextual facts, using a single well-formed output example, stating constraints in checkable terms, and decomposing complex tasks into verifiable steps. The article also notes that chain-of-thought prompting is now largely obsolete for reasoning models, with OpenAI itself advising against adding such instructions to its reasoning-focused model series.

0
ProgrammingDEV Community ·

How to Build a Private Local AI Server Using Ollama on Debian or Fedora

A developer guide published on DEV Community walks through setting up a fully private, self-hosted AI server using Ollama on a Debian-based machine, eliminating reliance on cloud services and recurring subscription fees. The setup requires a capable NVIDIA GPU with at least 8GB VRAM, 16GB of RAM, and an NVMe SSD, with NVIDIA hardware preferred due to its CUDA core advantage. Ollama, an open-source tool, handles model downloads and execution while exposing a local API on port 11434, and Open WebUI can be layered on top via Docker to provide a ChatGPT-like browser interface. Supported models include Meta's Llama 3, Mistral, DeepSeek Coder, and Microsoft's Phi-3, each suited to different use cases such as general tasks, coding, or low-power hardware. Advanced features like RAG — feeding the AI private PDFs or contracts — and VS Code integration via Continue.dev are highlighted as key benefits of keeping AI processing entirely on a local network.

0
ProgrammingDEV Community ·

Why 'Prompt Engineer' Splintered Into Other Roles Rather Than Disappearing

The title 'prompt engineer' never described a single job but rather four distinct activities: discovery, craft, systematisation, and evaluation, which emerged simultaneously when working with AI models was still largely experimental. As the field matured, each activity migrated into existing roles — craft merged into application engineering, systematisation became standard software practice, and evaluation grew into its own discipline on larger teams. Discovery, the most prominent early activity, had the shortest lifespan since documented techniques quickly replaced the need for individual experimentation. A structural problem also hastened the role's fragmentation: prompt authors who did not own the surrounding system had no way to measure whether their changes worked, making the standalone role untenable. The broader pattern mirrors how every new technical skill eventually gets absorbed into the roles that control the systems it depends on.

0
ProgrammingDEV Community ·

Developer warns: reading a client's repo, not running it, exposed a likely crypto scam

A software developer received a request from a prospective client to clone their repository, run it locally, and share a screenshot of the landing page ahead of a call. Recognising that executing unknown code risked exposing wallet keys, API tokens, and active browser sessions via malicious install hooks, the developer chose to read the codebase remotely instead. A forty-minute manual review revealed serious red flags: smart contracts that either burned user deposits or allowed anyone to drain unlimited rewards, a frontend containing assets from an unrelated real product, and a generic e-commerce backend with no connection to the claimed decentralised exchange. The repository had a single commit with no development history, and a tracked .env file ready to capture credentials. The developer identified the approach as a well-documented fake-recruiter attack pattern and advised others to read unfamiliar repositories rather than execute them.

0
ProgrammingDEV Community ·

Why a Green CI/CD Pipeline Does Not Guarantee a Safe Production Deploy

Engineering teams commonly equate a passing CI/CD pipeline with a safe deployment, but this assumption breaks down in predictable ways. Pipelines verify that code behaves correctly in test conditions yet rarely confirm whether the target production environment still matches what was tested against. Database migrations that run instantly on small test datasets can cause prolonged table locks and outages when applied to production tables with tens of millions of rows. Rollback procedures are another blind spot, often untested until an actual incident reveals missing images or schema incompatibilities. Over time, staging environments also drift from production through accumulated shortcuts, meaning a green pipeline may be validating code against conditions that no longer reflect reality.

0
ProgrammingDEV Community ·

8 Linux Myths That Still Trap Experienced Engineers in Production

A DevOps engineer writing for DEV Community outlines eight persistent Linux misconceptions that continue to affect even seasoned sysadmins and systems engineers. The article draws on a real 2021 incident where a 15-year veteran dropped the filesystem cache in production, causing a five-minute application outage as the kernel scrambled to reload data from disk. Key myths addressed include misreading the 'free' memory column instead of 'available', and blindly setting vm.swappiness=0, a practice whose behavior changed significantly after Linux kernel version 3.5. The author argues that Linux internals around memory management, process scheduling, and container isolation have evolved substantially over two decades, making outdated assumptions genuinely dangerous. The piece urges engineers to validate their understanding against current kernel mechanics rather than relying solely on years of accumulated experience.

0
ProgrammingHacker News ·

UK Met Office Launches Glacier Tracking Tool on Climate Dashboard

The UK Met Office has added a glacier monitoring section to its online Climate Dashboard. The tool provides data visualizations tracking the state and changes of glaciers globally. Glaciers are key indicators of climate change, making their inclusion on such platforms scientifically significant. The dashboard is publicly accessible and aims to present climate data in a transparent, understandable format.

0
ProgrammingHacker News ·

DeepSeek Quietly Launches V4 Pro 0813 Model Update

DeepSeek has released a new version of its AI model, referred to as V4 Pro 0813, without a formal public announcement. The release was noted by the developer community on Hacker News, where it garnered modest early attention. Details about the update are accessible through DeepSeek's official API documentation page. The low-key rollout follows the company's pattern of iterative model improvements. No official changelog or press release accompanied the launch at the time of reporting.

0
ProgrammingHacker News ·

Alibaba Releases Qwen3 235B-A22B MoE Model in FP8 Format on HuggingFace

Alibaba's Qwen team has published a new large language model called Qwen3 235B-A22B in FP8 quantized format on HuggingFace. The model follows a Mixture-of-Experts (MoE) architecture, activating a subset of its parameters during inference for greater efficiency. The release attracted attention on Hacker News, accumulating 37 points and community discussion. FP8 quantization reduces memory requirements, making large models more accessible for deployment on consumer or enterprise hardware.

0
ProgrammingHacker News ·

GitHub Experiences Incident Affecting Pull Requests and Issues

GitHub reported a service incident on Wednesday, August 12, impacting its Pull Requests and Issues features. The disruption was logged on the GitHub Status page, indicating a platform-level problem. The incident affected developers who rely on these core collaboration tools for code review and project tracking. GitHub's status page was updated to keep users informed of the ongoing situation. No further details about the cause or resolution timeline were immediately available from the report.

0
ProgrammingDEV Community ·

How to Self-Host Langfuse LLM Observability Platform Using Docker Compose

Langfuse is an open-source observability platform designed to monitor LLM applications by tracking traces, token usage, costs, and providing debugging analytics for AI workflows. A technical guide published on DEV Community outlines how to deploy Langfuse on a Linux server using Docker Compose, combining PostgreSQL, ClickHouse, Redis, and S3-compatible object storage. The setup is secured with Traefik as a reverse proxy and uses Let's Encrypt for automated TLS certificate management. Deployment requires a minimum of 4 vCPUs and 16GB RAM, a configured domain A record, and six randomly generated secrets for securing database and application credentials. Once running, the platform allows developers to send real traces through the stack and monitor production AI application behaviour from a self-hosted environment.

0
ProgrammingDEV Community ·

Controlled Vocabularies, Taxonomies, and Ontologies: Know What You Actually Need

In knowledge management, controlled vocabularies, taxonomies, and ontologies represent three distinct levels of data structuring, each roughly an order of magnitude more complex than the previous. A controlled vocabulary is simply a fixed list of agreed-upon terms with definitions, identifiers, and statuses — enough to enable consistent filtering and reporting. Adding a broader/narrower hierarchy to those terms creates a taxonomy, which enables roll-up queries and faceted navigation but introduces challenges like hierarchy disputes and non-tree-shaped domains. Ontologies go further by defining classes, properties, and logical axioms that allow machines to infer new facts, but require specialized modeling expertise and reasoning infrastructure. The article cautions that the term 'ontology' is frequently misused to describe all three levels, and most teams seeking one actually need nothing more than a well-maintained list of forty agreed-upon terms.

0
ProgrammingDEV Community ·

How to Safely Export and Verify ML Models Using ONNX Runtime

ONNX Runtime allows a single model artifact to run across CPU, GPU, and various accelerators via one API, eliminating much of the per-platform engineering work. However, the export process can silently introduce errors, including frozen control flow, operator decomposition into approximations, and numeric drift. Developers must carefully configure dynamic axes during export to avoid inference failures on variable-sized inputs, and should validate the exported graph's node count as an early warning of inefficient decomposition. Numerical accuracy should be verified by running both the original and exported models on identical inputs and comparing outputs within an explicit tolerance threshold. Opset versioning and provider-level operator support are additional compatibility concerns that can cause parts of a model to run on unintended hardware without any error being raised.

0
ProgrammingDEV Community ·

Developer builds memory auditor for AI agent, finds precision matters more than recall

A developer discovered that their coding agent's markdown-based memory system — spanning 90 files over two weeks — was storing factual claims about file paths, commands, and credentials that could silently become outdated. An automated auditor script was written to verify these claims against the actual machine state, initially flagging 45 of 90 files as invalid. However, the 50% failure rate proved misleading: false positives arose from the script misidentifying prose words, API routes, and Tailwind CSS classes as checkable filesystem or CLI entries. Targeted regex patterns and a CLI allowlist were introduced to distinguish genuinely verifiable claims from contextual or descriptive text. The project highlighted a subtle but critical distinction — a date recording a past event is permanently valid, while a date marking an expiry becomes stale the moment it passes.

0
ProgrammingDEV Community ·

Why AI Teams Should Build Guardrails Before Quality Metrics in Production

Online evaluation of AI systems differs fundamentally from offline testing because real production traffic shifts unpredictably due to new users, seasonal changes, and unanticipated query types. Unlike offline eval sets, which are static snapshots, online grading can detect silent model updates or routing changes from providers on the same day they occur. Experts recommend building programmatic guardrails first, as they check 100% of responses in near real-time at minimal cost and can actively block bad outputs, rather than merely measuring them after the fact. The common practice of grading a flat 1% of traffic is statistically arbitrary and often wasteful, since the required sample size depends on desired measurement precision, not on total traffic volume. Teams are advised to calculate sample sizes based on confidence intervals and to oversample suspicious requests, such as retried queries or guardrail near-misses, for more efficient use of their evaluation budget.

0
ProgrammingDEV Community ·

Why Using One AI Model for Everything Is Costing You More Than You Think

Relying on a single AI model across all tasks is a common engineering decision that often goes unquestioned for years, silently inflating costs and worsening latency without triggering any visible failures. A DEV Community analysis argues that real-world application workloads are not homogeneous and can be grouped into at least four distinct call types — mechanical transforms, bulk generation, user-facing reasoning, and long-context work — each with vastly different requirements. Smaller, cheaper models can match frontier model performance on simpler tasks like classification or field extraction, making blanket use of premium models wasteful. The article proposes a data-driven routing framework where engineers calculate per-class cost savings against accuracy risk using their own traffic logs and evaluation sets. The core argument is that whether to route calls to cheaper models is a measurable calculation, not a judgment call, and teams that skip it are paying frontier prices for work that does not need frontier capability.

0
ProgrammingDEV Community ·

Eight Ways AI Systems Catch Backend Engineers Off Guard

A technical analysis published on DEV Community argues that most backend engineering knowledge applies directly to AI/LLM systems, with three key exceptions: the cost model, the failure model, and the testing model. Unlike traditional services, LLM integrations bill per call, meaning retry loops and bursts can drain budgets rapidly in what the author calls a 'denial of wallet' vulnerability. Because models return probabilistic outputs, the same input can yield different results, making equality-based testing unreliable and bug reproduction difficult without stored request-response logs. HTTP error codes such as 400 and 429 can both signal billing issues with model providers, causing misclassification that either surfaces account problems to end users or triggers futile retry loops. The article also warns that malformed or incorrect model outputs still return as successful HTTP responses, making status-code dashboards blind to a significant category of failures.

0
ProgrammingHacker News ·

AI Coding Startup Lovable Raises $400M, Valuation Doubles to $13.3B

Lovable, an AI-powered coding startup, has raised $400 million in a new funding round. The raise values the company at $13.3 billion, doubling its previous valuation of $6.6 billion earlier in 2025. The funding round, announced via the company's blog, marks a Series C for the startup. The rapid valuation growth reflects continued investor appetite for AI development tools and platforms.

0
ProgrammingDEV Community ·

How Developers Can Fit AI Vision Tasks Into a Real-Time Frame Budget

A technical guide published on DEV Community breaks down how on-device computer vision pipelines must be engineered around a strict millisecond-per-frame budget determined by the target frame rate. At 30 fps, only roughly 15–25 ms remain for model inference after accounting for camera callbacks, format conversion, resizing, and overlay rendering. Input resolution is identified as the single most expensive variable, with costs scaling quadratically, making it critical to run models at the lowest resolution that still detects the smallest required object. Tasks such as classification, object detection, landmark tracking, segmentation, and OCR each carry distinct cost structures that developers must weigh when designing pipelines. The guide recommends decoupling detection from display and using cropped regions of interest rather than upscaling full frames to stay within budget.

← NewerPage 185 of 1338Older →