llms.txt
A proposed markdown file at a site's root that guides LLMs to important content.
llms.txt is a markdown file placed at /llms.txt that provides AI systems with a curated map of a website's most important pages. Proposed by Jeremy Howard in September 2024, it has been adopted by Anthropic, Vercel, Mintlify, and thousands of documentation sites.
Unlike robots.txt, llms.txt doesn't block anything — it's a content guide that helps LLMs find high-value pages quickly. Adoption is voluntary; major AI companies have not formally committed to reading it, but correlational data suggests it helps.
See also