SShortSingh.
Back to feed

Split E2E test repos create blind spots; new tool aims to catch breaks at PR review

0
·1 views

Many QA teams maintain end-to-end automation in a separate repository from the application it tests, which can cause developers to merge changes without knowing they have broken existing test specs. Because CI pipelines only run checks within their own repository, a failing E2E test in the automation repo may only surface hours after a PR has already merged. The core issue is that test specs are coupled to the app through textual anchors such as data-testid attributes, route strings, and aria-labels, and renaming any of these can silently break tests across the repository boundary. A QA automation engineer has built a GitHub App called Testward that extracts changed anchors from a PR diff, scans linked automation repositories for matching references, and posts a warning comment directly on the PR before it merges. The tool uses static text matching combined with an LLM filtering pass, though it acknowledges a known gap with dynamically generated selectors.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Guide: Zero-Downtime NestJS Deployment on DigitalOcean Using GitLab CI/CD and PM2

A detailed production-grade walkthrough has been published for deploying a NestJS backend to DigitalOcean with zero downtime. The setup uses Ubuntu 24.04, Node.js v18, PM2 in cluster mode, and Nginx as a reverse proxy, with GitLab CI/CD automating the deployment pipeline. The guide recommends installing Node.js directly from official binaries rather than using NodeSource scripts, which can install unintended versions. Security best practices are emphasized, including running deployments under a dedicated non-root user called 'deployer' instead of root. The walkthrough also covers SSL configuration via Certbot and proper Nginx proxy settings to ensure uninterrupted request handling during deployments.

0
ProgrammingDEV Community ·

Glass Box vs. Black Box: Why Query Transparency Matters in Backend Development

Backend developers commonly use database abstractions ranging from raw SQL to ORMs, but these tools vary widely in how much visibility they offer into actual query execution. A 'black box' approach hides the generated queries, making it difficult to diagnose performance issues or incorrect results during production incidents. In contrast, a 'glass box' approach prioritizes readable, deterministic queries that are pre-compiled and inspectable, reducing runtime surprises. The article argues that opacity in the data layer turns routine debugging into guesswork, especially under time pressure. Choosing transparent data access patterns can ease onboarding, improve performance tuning, and make refactoring safer for development teams.

0
ProgrammingDEV Community ·

AI Research Engine Detects Unmeasured Chebyshev Bias in Goldbach Partition Counts

A developer built an autonomous AI research tool called Luka and directed it at Goldbach's conjecture, one of mathematics' oldest unsolved problems. Luka computed Goldbach partition counts for over 2.4 million even integers and found that numbers congruent to 1 (mod 3) consistently produce 0.26% more prime-pair representations than those congruent to 2 (mod 3). This asymmetry contradicts the Hardy–Littlewood formula, which predicts equal counts for both residue classes, and was confirmed with an exceptionally low p-value of 4.07 × 10⁻²⁰⁴. The developer attributes the bias to Chebyshev's known tendency to favor primes in certain residue classes, a effect that appears to amplify when convolved through Goldbach's bilinear structure. The findings, shared on DEV Community along with open-source Python code, are presented as a proof of concept for AI-assisted mathematical discovery rather than a formal peer-reviewed proof.

0
ProgrammingDEV Community ·

Developer's AI Engine Uncovers Systematic Error Pattern in Twin Prime Formula

A software developer built an autonomous AI research engine called Luka and directed it toward the twin prime conjecture, one of mathematics' long-standing unsolved problems. Luka analyzed verified twin prime counts across 33 data points spanning eight orders of magnitude, from 10⁶ to 10¹⁴. It found that the residual between the widely used Hardy-Littlewood approximation and actual twin prime counts follows a consistent power law with an R² of 0.9907, later refined to 0.9997 with an additional logarithmic term. Further analysis revealed this pattern reflects a known second-order asymptotic error in the simplified approximation formula rather than a new property of twin primes themselves. Luka also tested and statistically falsified a recent oscillatory model called PRIT, whose predictions deviated from actual values by factors of 100 to 700.

Split E2E test repos create blind spots; new tool aims to catch breaks at PR review · ShortSingh