What is llms.txt?
Also called: llms-full.txt
Definition
llms.txt is a proposed web standard for a plain Markdown file, served at /llms.txt, that gives large language models a short, curated summary of a website and links to its most useful pages. It was proposed by Jeremy Howard of Answer.AI in September 2024.
Explained
The file starts with the site name as a heading and a one-paragraph summary, followed by sections of links with short descriptions. A companion file, often called llms-full.txt, can contain the full text of key pages so a model can read them in one request.
It is not an official standard, and major AI companies have not committed to using it the way search engines use robots.txt or sitemaps. It is cheap to add, though, and useful for AI coding tools and agents that fetch documentation. Treat it as a helpful extra, not a ranking lever.
Example
This site publishes /llms.txt with a summary of what Mentioned measures, its pricing and links to each guide, and /llms-full.txt with the full text of the guides.