SShortSingh.
Back to feed

How Self-Healing Test Tools Actually Work, and Why Their Fixes Can Backfire

0
·1 views

The article explains that automated UI tests locate page elements by reading the HTML DOM, so changes like shifted position, altered color, image-based buttons, or translated labels can break element lookups. Such failures often reflect setup problems rather than the behavior the test was meant to verify, which makes debugging costly. So-called self-healing tests do not truly repair themselves; an agent analyzes failures, guesses the intended element, and rewrites the test. The author argues this process can hide real issues and introduce risks, since the healing mechanism may substitute a different element than the one originally intended.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Why Fire Escapes Have Fallen Out of Use in Modern Buildings

A Practical Engineering blog post examines why fire escapes, once a common feature of city buildings, are less prevalent today. The article is published on the author's site and was shared on Hacker News, where it received a small amount of attention. The provided material offers only the headline, link, and engagement figures, so the specific reasons discussed in the post cannot be confirmed here. Readers interested in the engineering and regulatory factors behind the change would need to consult the full article.

0
ProgrammingDEV Community ·

Deriving Roof Pitch and Azimuth from Drone Point Clouds Using Python

A drone survey of a roof produces a point cloud of millions of 3D points describing the surface. For solar and roofing work, the key figures are each roof plane's steepness, its facing direction, and its surface area. The approach described uses Python with techniques such as SVD, RANSAC plane fitting, and basic trigonometry to convert raw points into these measurements. The author suggests testing the method on real scans, comparing results against hand measurements, and adjusting thresholds to match the physical roof. Readers are invited to extend the work, for instance with alpha-shape area calculations or obstruction detection.

0
ProgrammingDEV Community ·

Why AI Demos Stall Before Production, and What Teams Must Engineer

Impressive AI demos often take an afternoon to build, but projects can stall for months because a demo tested on a handful of hand-picked examples says little about performance on real cases. Moving to production is mostly ordinary engineering rather than model selection, covering output correctness, integration with software, permission controls, cost tracking, and safe rollout. A central practice is an evaluation set of real inputs with expected correct outputs that can be scored automatically, growing over time as production failures are added. For open-ended outputs, using a second model as a judge can scale evaluation, but it must be calibrated against human labels and its false passes and false fails tracked separately. Structured, schema-validated outputs and specific yes/no rubric questions are also recommended over vague scores or assumed-valid free text.

0
ProgrammingDEV Community ·

How Developers Can Tell Whether Traffic Spikes Signal a Real Data Breach

A common security disclosure phrase says traces of unauthorized access were confirmed, but the article explains how developers can check this themselves. A sudden spike in requests or data egress on a platform like Supabase often stems from internal problems such as buggy client code, heavy unindexed queries, or large unoptimized assets rather than an external attack. Row-Level Security can block unauthenticated reads by returning empty results with a 200 status, so request volume alone does not show data was stolen. The author recommends comparing request counts against egress, reviewing HTTP status codes such as 401, 403, and 429 for signs of automated probing, and checking the network origin of unfamiliar IPs. Together these signals help distinguish harmless internal issues from genuine exposure.