How to Serve Markdown to AI Agents from Hugo Sites on Cloudflare Pages Free Plan

·1 views

AI agents and LLM crawlers prefer plain Markdown over HTML, but static hosting platforms like Cloudflare Pages cannot perform content negotiation based on request headers. A developer has outlined a two-part solution using Hugo and Cloudflare Pages that works entirely within the free tier. At build time, Hugo is configured to generate a companion .md file alongside every index.html using its output formats feature. At request time, a lightweight Cloudflare Pages Function reads the Accept header and serves the pre-built Markdown file when a client requests text/markdown, leaving browser requests unaffected. Because the Markdown is pre-rendered as a static file, the function does minimal processing and stays well within free-tier usage limits.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Vercel Sandbox Offers Isolated MicroVMs to Safely Run AI-Generated Code

Vercel Sandbox runs untrusted code, including AI-generated scripts, inside ephemeral Firecracker microVMs that are fully isolated from the host application's process, filesystem, and environment variables. Each sandbox is created on demand, executes the required commands, and is discarded afterward, preventing any persistent access or state leakage. Unlike running code via child_process or eval within a Vercel Function, the sandbox approach ensures that compromised or malicious code cannot access API keys, database URLs, or other secrets. Developers can configure per-sandbox timeouts and CPU limits, and expose running servers on public URLs for live previews of AI-generated components. Vercel Sandbox is intended specifically for untrusted, externally authored code rather than first-party build or CI pipelines.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Guillotine vs Free Nesting: Choosing the Right Sheet Cutting Method

When laying out rectangular parts on sheet material, two main cutting strategies exist: guillotine cutting, which uses full straight cuts across the entire sheet, and free nesting, which places parts more flexibly to reduce waste. Guillotine cutting suits machines like panel saws and table saws where strip-based workflows and simple cut sequences are prioritized over maximum material efficiency. Free nesting can minimize offcuts but may introduce complex or awkward cuts depending on the equipment being used. The choice should factor in material cost, machine capability, and the operator's ability to execute a safe cutting sequence. A free browser tool called CutListEngine allows users to compare both methods using the same inputs without requiring a signup or file upload.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How to Choose the Right Linux Distribution Based on Your Use Case

No single Linux distribution suits every user, as the best choice depends on individual needs, experience level, and intended tasks. Beginners are advised to start with user-friendly options like Ubuntu, Linux Mint, or Zorin OS, while developers may prefer Fedora or Arch Linux for access to cutting-edge tools. Gamers can turn to distributions such as Bazzite or Pop!_OS, and cybersecurity professionals commonly rely on Kali Linux or Parrot OS for penetration testing. Server administrators are pointed toward stable options like Debian and Rocky Linux, while lightweight distributions such as Lubuntu and Linux Lite can breathe new life into older hardware. Experts recommend basing the choice on actual usage requirements rather than popularity, and suggest testing options via a Live USB before committing to a permanent installation.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Cloudflare silently blocked ChatGPT, Perplexity and Claude bots for three weeks

A developer discovered that Cloudflare's 'Block AI Bots' security setting had been silently returning HTTP 403 errors to AI search crawlers — including OpenAI's SearchBot, PerplexityBot, and Claude-SearchBot — for three weeks, while standard search engines like Googlebot passed through unaffected. Because the blocks occurred at the edge before requests reached the origin server, Apache access logs recorded nothing, making the problem invisible to conventional monitoring tools. The developer only uncovered the issue by manually simulating each bot's user agent with curl against the live public URL, bypassing local network shortcuts. A secondary problem was also found: fail2ban was misreading Cloudflare relay IPs as malicious clients and banning them, which periodically caused HTTP 521 errors for all visitors. The developer responded by building a daily automated crawler check that probes the real public URL across 16 user agents and alerts on any unexpected status change.

0 comments Read more at DEV Community