Developer bypasses Akamai Bot Manager using real Chrome browser driven via CDP

·3 views

A professional web scraper detailed how he overcame Akamai Bot Manager protections on the German car listings site mobile.de after standard methods repeatedly failed. Plain HTTP requests, TLS fingerprint spoofing, and headless browser automation via Playwright and Puppeteer were all detected and blocked by Akamai's bot detection scripts. The author noted that Akamai evaluates browser behaviour beyond the TLS handshake, running JavaScript that checks for a real rendering engine and browser internals that automated clients cannot replicate. The eventual solution was to launch a genuine Chrome binary with a real user profile and control it remotely using the Chrome DevTools Protocol (CDP) via Playwright's connect_over_cdp method. Because the browser was entirely authentic rather than simulated, Akamai found nothing to flag, and the scraper successfully retrieved 64 complete car listings.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

[Boost]

Agentic Design System sandeep kumar patel Sep 19 Add Comment 1 min read

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AWS Confirms Permanent Data Loss in Middle East Regions After Military Strikes

AWS publicly acknowledged on September 15, 2026, that customer data has been permanently lost across its Bahrain (me-south-1) and UAE (me-central-1) regions following a series of military attacks between March and July 2026. The Bahrain region suffered complete, unrecoverable data loss across all three Availability Zones, while one of three AZs in the UAE region also lost data irretrievably. AWS stated that the destruction spread across multiple Availability Zones, exceeding what its regional and multi-AZ architecture was designed to withstand — effectively acknowledging that multi-AZ redundancy does not protect against large-scale physical warfare. Structural damage, power disruption, and water damage from firefighting operations were cited as key causes of the infrastructure failure. Data lost belonged primarily to customers who had not migrated workloads or maintained backups in other regions before the outages occurred.

0 comments Read more at DEV Community

ProgrammingHacker News ·

Spain Orders ISPs to Block Archive.today and Its Mirror Sites

Spain has ordered the blocking of Archive.today, a web archiving and caching service, along with its mirror sites. The directive appears to require internet service providers within Spain to restrict access to the platform. Archive.today is widely used to preserve and share snapshots of web pages, often bypassing paywalls or preserving content that may later be deleted. The exact legal basis or authority behind the blocking order has not been detailed in the available information. The move has drawn attention from internet freedom advocates and the tech community.

0 comments Read more at Hacker News

ProgrammingDEV Community ·

B.Tech Graduate Builds Secure School Portal After 2023 Dehradun Cyber Fraud Case

A recent computer science graduate from Graphic Era Hill University developed a Secure School Management Portal after learning about a 2023 cyber fraud incident in Dehradun, Uttarakhand. In that incident, school manager Shambhu Prasad Pancholi lost ₹95,000 after a fraudster posing as a student's parent sent malicious WhatsApp links that enabled four unauthorized bank transactions. The incident, reported by the Times of India, required no OTP and exploited the manager's trust in a routine fee-payment scenario. Motivated by the case, the developer built a web portal with separate access portals for admins, teachers, and students, incorporating multiple layers of security including authentication and access control. The project, completed as a final-year initiative in 2025, was a personal learning exercise and is not affiliated with the school involved in the original fraud.

0 comments Read more at DEV Community