SShortSingh.
Back to feed

Silent Coordinate Mismatch Can Cause All Browser Automation Clicks to Miss Target

0
·1 views

A developer running an AI browser automation agent to list a product across four marketplaces discovered that clicks were silently landing in the wrong locations with no errors or logs. The root cause was a mismatch between screenshot pixel space and CSS pixel space — when the screenshot resolution differed from the viewport width, every DOM-derived coordinate was off by a constant factor. In this case, a 1702 CSS-pixel-wide viewport was captured in screenshots at roughly 1274 pixels, producing a scaling factor of approximately 0.748. The developer identified the bug by injecting a test button at a known position and confirming that click events were never actually arriving at their intended target. Applying a single coordinate conversion function using the measured scaling factor immediately resolved all previously failing interactions, including dropdowns, menus, and confirmation dialogs.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

True Cost of Shipping an iOS App in 2025: As Low as $99/Year

Publishing an app on Apple's App Store requires an active Apple Developer Program membership at $99 per year, the only unavoidable expense. Developers also need a machine capable of running Xcode for building and signing apps, but this can be handled for free using GitHub Actions on a public repository. Optional costs include purchasing a Mac (from ~$799) or renting a cloud Mac ($20–$100/month), which significantly raise first-year expenses. Tools like TestFlight, App Store listings, and screenshots carry no additional fees beyond the membership. A developer shipping a side project via a public repo can therefore bring total annual costs down to just $99.

0
ProgrammingDEV Community ·

How GitHub Actions' free macOS minutes work for iOS app builds

GitHub Actions offers free macOS runner minutes for CI/CD pipelines, including the ability to build and sign iOS apps using Xcode command-line tools. Public repositories on any GitHub plan receive unlimited free macOS minutes, while private repositories are subject to a monthly allowance ranging from 2,000 to 3,000 minutes depending on the plan. Because macOS runners consume minutes at roughly 10 times the rate of Linux runners, a private repo on the free plan effectively gets around 200 macOS build minutes per month before additional charges apply. Repo visibility affects only CI minute pricing — signing credentials stored in GitHub secrets remain encrypted and protected regardless of whether a repository is public or private. Developers still need to pay Apple's $99 annual Developer Program fee separately, as that cost is entirely outside GitHub's billing system.

0
ProgrammingDEV Community ·

Why Organizational Context for AI Agents Should Be a Platform Responsibility

Developers using AI agents in enterprise environments currently spend significant time manually assembling context — pasting runbooks, standards, and conventions — before each session, only to repeat the process the next day since agents do not retain organizational knowledge. This ad-hoc approach means output quality varies widely, with stronger engineers producing better results simply because they gather better context. The problem compounds as AI adoption grows: the more teams use agents, the greater the collective burden of hand-assembling this information across hundreds of developers. Many teams have begun building their own context layers through files like CLAUDE.md or AGENTS.md, signaling an unmet platform need. The author argues that surfacing and maintaining organizational knowledge for AI agents — covering service ownership, architectural standards, security classifications, and operational history — should be treated as a core internal platform capability rather than each developer's individual responsibility.

0
ProgrammingDEV Community ·

Why TestFlight silently drops your build after a successful CI upload

App Store Connect silently rejects uploaded builds that share an identical marketing version and build number with a previously submitted build, treating them as duplicates. The upload tool reports a successful file transfer regardless, making the failure invisible in CI logs and leaving developers confused when no new build appears in TestFlight. The fix is to ensure the build number (CURRENT_PROJECT_VERSION) increments on every upload, which in GitHub Actions can be automated using the built-in github.run_number variable. A common cause of the issue is a dynamic build number being accidentally dropped during customization of the archive step, or an environment variable silently expanding to empty in the wrong shell context. Developers can also check 'Build Activity' in App Store Connect for processing history, and should allow a few minutes for even successful uploads to finish processing.

Silent Coordinate Mismatch Can Cause All Browser Automation Clicks to Miss Target · ShortSingh