Open-Source AI Tool Flags UX Friction by Drawing Bounding Boxes on Webpages
A team building Plyxo Community Edition has developed an open-source Visual CRO (Conversion Rate Optimization) engine that identifies UX and design friction points traditional tools like Google Lighthouse cannot detect. The system uses a Puppeteer-powered headless Chrome pipeline to capture high-DPI full-page screenshots of any target URL. Those screenshots are then passed to a multimodal vision model, which returns structured JSON containing normalized bounding-box coordinates that pinpoint problem areas such as low-contrast CTAs, cluttered pricing tables, or hidden form requirements. An interactive canvas overlay renders the flagged zones visually on the screenshot, and the model simultaneously generates Tailwind CSS code fixes that developers can copy and apply directly. The project is open-source and aims to bridge the gap between automated performance auditing and human-level visual UX analysis.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in