GoodBarber Serves Markdown Pages to AI Agents via Header and URL for Two Weeks

App platform GoodBarber added a Markdown version of every public page on its marketing website starting September 4, accessible either via an Accept: text/markdown header or by appending .md to any URL. The system was built without duplicating content or modifying templates, converting Markdown directly from cached HTML through a Django middleware layer. Each Markdown page includes YAML front matter with metadata drawn from the page's JSON-LD, a link back to the canonical page, and an X-Robots-Tag to prevent search indexing. The dual-door approach was designed to accommodate AI coding agents that send the Accept header, such as Claude Code and Cursor, as well as those that do not, like Copilot and Gemini CLI. After two weeks of logging all requests through both access methods, the engineering team analyzed the nginx logs to assess how AI agents and crawlers were actually fetching and using the Markdown content.