Open-Source Tool 'Ghost Browser' Gives AI Agents Real Browser Control to Act Online

A developer has open-sourced a tool called Ghost Browser that addresses a core limitation of AI agents: the inability to perform real, logged-in actions on websites. While much debate around AI agents focuses on reasoning and memory, the author argues the bigger gap is execution — an LLM can decide to post or message someone but has no native way to do it. Ghost Browser solves this by running a real Chromium instance that uses a visual technique called Set-of-Mark, which overlays numbered boxes on interactive page elements and lets the agent act by referencing those numbers rather than fragile CSS selectors. Sessions are established once by the user and stored in isolated profiles, so the agent operates as a genuinely logged-in user without repeated authentication. Consequential actions like posting or following require explicit human approval by default, with a built-in guard that intercepts such clicks and converts them into proposals for review.