What is llms.txt, and does it help AI find your website? What our data shows
llms.txt is a proposed Markdown file that gives AI tools a map of a website. Google says Search ignores it, no AI company says its assistant reads other sites' files, and in our check sites with one had serious problems at exactly the same rate as sites without. What it is, who reads it, and when to bother.
llms.txt is a proposed file that gives AI tools a short, readable guide to a website. Search for it and you will find two kinds of advice: add one now or be left behind, or don't bother because it does nothing. The truth is narrower than both, and our study has a number on it.
What llms.txt is
Jeremy Howard of Answer.AI proposed it on September 3, 2024 (the proposal, now maintained at llmstxt.org). It is a Markdown file at /llms.txt on your domain: the site's name as a heading, a short summary, then sections of links with a line about each. The idea is that an AI tool reading your site while it answers a question gets a clean map, instead of digging through menus, scripts and cookie banners.
For a small shop it might look like this:
# Main Street Vintage
> Secondhand clothing and furniture store in Round Rock, Texas.
> Open Tuesday to Sunday, 10am to 6pm. Donations at the back door.
## Visit
- [Hours and directions](https://www.example.com/visit/): parking, accessibility, holiday hours
- [What we buy](https://www.example.com/sell/): brands, condition, how we pay
## Shop
- [New arrivals](https://www.example.com/new/): updated every Thursday
- [Furniture](https://www.example.com/furniture/): delivery within 20 miles
We publish one ourselves, at pixelandoak.com/llms.txt. Our build writes it from the same data as the pages, so it never falls out of date.
Who reads it
As of August 2026, llmstxt.org says thousands of sites publish one, OpenAI, Anthropic and Google's Gemini team among them for their developer documentation, and that Chrome's Lighthouse looks for one in its agentic-browsing audits. What it does not claim is that any search engine or AI assistant uses llms.txt to decide which sites to show or cite. Nor does anyone in a position to:
- Google added an AI optimization guide to its Search documentation in May 2026, with a note on llms.txt in June. It says Google Search does not use such files, and that keeping one for other services "will neither harm nor help your site's visibility or rankings in Google Search" (Google's guide).
- John Mueller of Google Search wrote on Bluesky in June 2025 that no AI system currently uses llms.txt (his post). In January 2026 he added that an llms.txt file on one of Google's own developer sites was not an endorsement.
- OpenAI and Anthropic publish llms.txt files for their own documentation, but neither has said its assistant reads other sites' files. OpenAI's guidance for appearing in ChatGPT search covers its crawler, its IP addresses and robots.txt, and nothing else.
- Microsoft's Bing webmaster guidelines, which also cover Copilot, do not mention it.
Some site owners have seen AI crawlers request their llms.txt in server logs. A request shows the file was fetched, not that it shaped an answer.
What our data shows
In our check of 348 small-business websites, 78 (22%) had an llms.txt file. We compared them with the 270 that did not:
| Sites | With a serious problem | Share | |
|---|---|---|---|
| Has llms.txt | 78 | 19 | 24.4% |
| No llms.txt | 270 | 66 | 24.4% |
A serious problem is one that can keep a site out of AI answers on its own: a robots.txt rule against an AI search crawler, a robots.txt that will not load, a firewall that lets a browser in but turns AI search crawlers away, a homepage with almost no text in its HTML, or a noindex tag. Sites with an llms.txt had them at exactly the same rate as sites without. A map of your pages does not help when crawlers cannot fetch those pages, or find nothing in them when they do.
That does not prove llms.txt is useless; it measures something else. It does show that the sites adding one were not, on the whole, the ones that had fixed the basics.
Should you add one?
- Yes, if you publish documentation, an API or software that people use with AI coding tools and agents. That is the use the proposal was written for, and it is how OpenAI and Anthropic use their own files.
- Optional, if you run a local business. It does no harm and takes little time, but do the basics first.
- No, if someone is selling it to you as a way to rank in AI answers. Nothing any AI company has published supports that.
The basics, which matter far more: let the AI search crawlers in, make sure your text is in the HTML, and say plainly who you are, where you work and what you charge. The full list, from our study.
How to make one
- Write a plain-text Markdown file named
llms.txtlike the example above: one#heading, a>summary, then##sections of links. - Link only to pages you want AI tools to read, with a line on what each one answers.
- Upload it to the root of your site so it loads at
yourdomain/llms.txt. On WordPress, some SEO plugins can generate it for you. - Keep it current. A file that lists last year's prices is worse than none.
Questions
Does ChatGPT use llms.txt?
OpenAI has not said so. Its guidance for appearing in ChatGPT search covers OAI-SearchBot, OpenAI's IP addresses and robots.txt. What does matter for ChatGPT.
Is llms.txt a standard?
No. It is a community proposal with a public specification, not a standard adopted by a standards body or required by any search engine.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers where they may go, and the major ones follow it. llms.txt suggests what to read, and nothing is obliged to read it. robots.txt templates.
Day 11 of 20. The free AI visibility checker reports whether your site has an llms.txt, alongside the checks that matter more.