What is llms.txt?

llms.txt is a proposed plain-text Markdown file placed at a site's root that gives AI systems a concise summary of the site and links to its most important pages.

By the AIO Automatic team · Last updated

What is an llms.txt file?

llms.txt is a Markdown file at yoursite.com/llms.txt that starts with your brand name, a one-line summary, and then lists your key pages with short descriptions. It gives language models a clean, curated map of your site without navigation, scripts or ads. Some sites add an llms-full.txt with the full text of core pages.

You can see ours at aioautomatic.ai/llms.txt.

Do AI engines actually use llms.txt?

Adoption is uneven. It is a proposed standard, not an official requirement from OpenAI, Anthropic or Google, and none guarantee they read it. It is cheap to publish and helps AI agents and tools that do fetch it, so treat it as a low-cost supplement to robots.txt, sitemaps and good on-page content.

llms.txt vs robots.txt vs sitemap
FilePurposeFormat
robots.txtTells crawlers what they may fetchDirectives
sitemap.xmlLists every URL for discoveryXML
llms.txtCurated summary and key links for AIMarkdown

Frequently asked questions

Does llms.txt replace robots.txt?

No. robots.txt controls access. llms.txt only describes your site.

What should go in llms.txt?

Your brand sentence, what you offer, who it is for, and links to your most important pages with one-line descriptions.