Scrapy-Playwright Adds Native Support for Camoufox and Custom Browser Providers
A new configuration option called PLAYWRIGHT_BROWSER_PROVIDER has been added to scrapy-playwright, allowing developers to replace the default Playwright browser with any compatible alternative, such as Camoufox. Previously, integrating a custom browser required running it separately and connecting via CDP, a workaround that was cumbersome to maintain. The change addresses a long-standing frustration in the web scraping community, where standard Playwright browser binaries are easily detected by anti-bot systems due to their well-known fingerprints. Stealth browsers like Camoufox compile modifications directly into the binary, making automated traffic harder to detect than runtime patches. The new provider interface is a small Python class that plugs into Scrapy's existing architecture, streamlining what was once a multi-step manual setup.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in