What the file actually is
llms.txt is a community proposal: a file at /llms.txt that lists your most important pages with short descriptions, in clean Markdown, so a language model can ingest a curated map of your site cheaply. There is usually a companion /llms-full.txt that flattens the actual content. The idea is sensible: the same instinct as a sitemap or a robots.txt, aimed at AI instead of search crawlers.
What the evidence says (the part vendors skip)
Here is where honesty matters. The marketing around llms.txt has run well ahead of the facts.
Google has said plainly it does not use llms.txt and has no plans to, comparing it to the long-ignored keywords meta tag. OpenAI and Anthropic point site owners to robots.txt for crawler control, not llms.txt. Among the most AI-cited domains on the web, almost none rely on the file. Adoption is growing fast, but publishing a file is not the same as any model reading it.
“Publishing an llms.txt is not evidence that anything consumes it. Treat it as low-cost hygiene, never as the reason you will get cited.”
So should you add one?
Yes, if it is basically free to generate and maintain. It does no harm, it is tidy, and if the standard is ever widely adopted you are ready. No, if someone is charging you a meaningful sum for it, or claiming it will get you into ChatGPT. Spend that money on the things that actually move the needle instead:
- Crawler access, make sure GPTBot, ClaudeBot and PerplexityBot are not blocked at robots.txt or your CDN. See is your website blocking ChatGPT.
- Server-rendered HTML, real content in the first response, because most AI crawlers do not run JavaScript.
- Answer-first structure, direct answers, question-shaped headings, FAQ blocks a model can extract cleanly.
- Off-site trust, mentions, reviews and citations on the third-party sources assistants lean on.



