x402 Protocol Lets Crawlers Pay for Web Access, Backed by Cloudflare and Coinbase

A new open standard called x402 revives the long-dormant HTTP 402 'Payment Required' status code, enabling websites to charge AI crawlers and bots for content access via on-chain micropayments. The protocol, now part of the Linux Foundation, is backed by major tech and finance players including Cloudflare, Coinbase, AWS, Google, Stripe, and Visa. When a client hits a payment-protected endpoint, it completes a blockchain transaction and attaches a payment signature to a retry request before the server serves the content. The standard aims to resolve the growing tension between site owners and the surge in bot traffic, which now accounts for 57% of all internet traffic, up from 20% in 2021. Developers can build x402-aware crawlers in Go using a modular architecture that separates protocol handling, crawl logic, and budget tracking into distinct, independently governed components.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in