Relax.
You may have seen a line about "llms.txt" in a speed test report. Or someone told you every website needs one to show up in AI search. Here's the short answer: for most small business sites, no, not yet. It's cheap to add, but nobody has shown that it brings you customers.
Here's the plain version of what it is, what the data says, and what I'd spend your time on instead.
What llms.txt is
It's a plain text file that sits at yoursite.com/llms.txt. Jeremy Howard of Answer.AI proposed it in September 2024. Think of it as a short, curated list of your most important pages, written for a machine instead of a person: your site name, a one-line summary, and links with a short note on each.
It's a suggestion, nothing more. It doesn't block anything, it doesn't grant anything, and no AI tool is required to read it. That's different from robots.txt, which tells well-behaved crawlers where they may go, and from a sitemap, which lists the pages you want indexed.
Why Google seems to say two different things
Google's own Search guidance says you don't need llms.txt, or any special AI files, to show up in Google Search, including its AI features. Yet Chrome's Lighthouse speed tool now has an experimental "Agentic Browsing" check that mentions the file. If you ran a PageSpeed report lately, you may have seen it.
Those are two different jobs. Google Search already reads your real pages, so it doesn't need a map. A browser agent that lands on your site cold may benefit from one. A missing file isn't counted against you, either. The audit marks it "not applicable" because the file is optional.
Is anything actually reading it?
Not much, so far. Ahrefs studied 137,210 sites that had traffic in May 2026. About 28% had an llms.txt file, and 97% of those files received zero requests that month. Of the requests that did arrive, AI retrieval bots made up only about 1% of them. Ahrefs customers lean technical, so the real-world adoption rate is probably lower than 28%.
The other big test came from SE Ranking in late 2025. They looked at close to 300,000 domains and found no sign that having the file improved AI citations or traffic.
The place it clearly makes sense is developer documentation. Coding assistants pull reference material from it, and several software companies publish one for that reason.
So does your business need one?
- You publish developer docs or an API: yes, add one.
- You run a large knowledge base: maybe, if it's cheap to keep current.
- You're a local service business, a ministry, a portfolio or a blog: not a priority. The research doesn't show a search or AI benefit for sites like yours.
If you add one anyway
Yoast SEO and Rank Math both have a setting that creates the file for you. In Yoast it's under Settings, Site features. If you go that route:
- Look at the public file. Make sure it lists only pages you want public. Drafts and noindexed pages shouldn't be in it.
- Keep it current. A file that points to deleted pages is worse than no file. Check it after any redesign.
- Don't trade real content for it. The file never replaces clear pages and plain language.
What to do instead
The work that helps Google also helps AI tools, and it hasn't changed:
- Pages that say plainly what you do, who you do it for and where.
- The same business name, address and phone number everywhere they appear.
- Real reviews from real customers.
- A fast site with clean structure and accurate descriptions.
If someone sells llms.txt as the secret to ranking in AI answers, ask to see the data. Right now the data says it isn't.
Want to know how your own site reads to Google and to AI tools? Ask for your free Your Plan. I'll look at it myself and send you a personal video with three things you can change today.
Got questions about any of this? Call Ron at 731-412-0766.