tapflow Uses XCUITest HTTP Server to Read iOS UI Elements Without a Simulator Window
Mobile UI tests that rely on screen coordinates are fragile — a single button repositioned during a redesign can silently break an entire test suite. tapflow, an open-source tool that streams iOS simulators and Android emulators to a browser, has introduced a new approach that identifies UI elements by their properties rather than their pixel location. The solution embeds a persistent XCUITest target inside the simulator that runs a lightweight HTTP server, responding to queries about the on-screen accessibility tree without requiring a visible simulator window. This allows headless agent machines to serve element data — including roles, labels, identifiers, and frames — for any app by bundle ID over a local connection. The feature is currently experimental and is designed to support a future flow-replay system capable of surviving app redesigns.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in