llms.txt Format Explained: Structure, Template and Common Errors
llms.txt is a Markdown file served at /llms.txt that gives AI tools a short, curated list of a site's key pages. It is a community proposal from llmstxt.org first written in 2024, and it is optional rather than an official standard. The proposal defines a fixed order: a required H1 with the site name, an optional blockquote summary, optional detail sections, and H2 link lists, with an optional section for secondary links. The article provides an example template and explains how to publish the file and confirm it returns a 200 status with a non-HTML content type. It also notes that the author's own auditor checks only format compliance, and that the crawler documentation it reviewed treats robots.txt, not llms.txt, as the control for AI access.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in