Split E2E test repos create blind spots; new tool aims to catch breaks at PR review
Many QA teams maintain end-to-end automation in a separate repository from the application it tests, which can cause developers to merge changes without knowing they have broken existing test specs. Because CI pipelines only run checks within their own repository, a failing E2E test in the automation repo may only surface hours after a PR has already merged. The core issue is that test specs are coupled to the app through textual anchors such as data-testid attributes, route strings, and aria-labels, and renaming any of these can silently break tests across the repository boundary. A QA automation engineer has built a GitHub App called Testward that extracts changed anchors from a PR diff, scans linked automation repositories for matching references, and posts a warning comment directly on the PR before it merges. The tool uses static text matching combined with an LLM filtering pass, though it acknowledges a known gap with dynamically generated selectors.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in