llms.txt is a plain-text file at the root of a website (yoursite.com/llms.txt) that gives AI tools a short, organized summary of the site: who you are, what you offer, and links to your most important pages. It was proposed in 2024 as a standard way to help large language models find a site’s best content. It’s cheap and harmless to add, but no major AI company has confirmed it affects rankings or recommendations, so treat it as a helpful extra, not a strategy.
I add llms.txt files for clients as part of AI search optimization work, and I get asked about it constantly. Here’s the honest version.
What goes in an llms.txt file
The format is simple Markdown. A typical file has:
- A heading with your business name.
- A one-paragraph summary: what you do, where, and for whom.
- A few key facts: location, contact details, specialties.
- Sections of links to important pages, each with a one-line description: services, portfolio, about, pricing, guides.
You can see ours at https://pennerwebdesign.com/llms.txt.
What llms.txt does and doesn’t do
It does give AI tools that choose to read it a clean summary of your business, without menus, cookie banners, and pop-ups in the way. It’s useful for AI coding and research tools, and it forces you to spell out clearly what your business does, which helps your website copy too.
It doesn’t guarantee anything. As of 2026, the big AI search products haven’t said they use llms.txt when deciding whom to recommend. Anyone selling llms.txt as the key to ranking in ChatGPT is overselling it.
What matters more than llms.txt
- robots.txt access for AI search bots. If your robots.txt, security plugin, or firewall blocks crawlers like OAI-SearchBot (ChatGPT search), Claude-SearchBot, PerplexityBot, or Bingbot, your site can’t show up in their answers at all. Check this first.
- Structured data. Schema markup that describes your business, services, people, and FAQs in a format machines read reliably.
- Answer-first content. Pages that answer a real question clearly in the first few sentences, like this one.
- Consistent facts everywhere. The same business name, location, and services on your site, Google Business Profile, directories, and social profiles.
- Independent mentions. Reviews, articles, and listings on other sites. AI engines lean heavily on what other people say about you.
robots.txt vs. llms.txt
They do different jobs. robots.txt tells crawlers what they’re allowed to visit. llms.txt suggests what’s worth reading. A site can have a perfect llms.txt and still be invisible to AI if robots.txt blocks the bots, so always check robots.txt first.
How to add llms.txt to a WordPress site
- The easy route: Yoast SEO can generate a basic llms.txt for you. It’s under Yoast SEO, Settings, Site features.
- The better route: write one by hand, or generate it from your real services and pages so it stays current when you add content. We build ours to update automatically when a new post or portfolio project goes live.
- Upload it to the root of your site so it loads at yoursite.com/llms.txt. If your host serves a static file there, remember that it will override anything WordPress generates.
- While you’re there, check robots.txt and make sure you aren’t blocking the AI search crawlers you want to be found by.
Frequently Asked Questions
llms.txt is a Markdown file at the root of a website that summarizes the business and links to its most important pages, so AI tools can understand the site quickly. It was proposed in 2024 as a voluntary standard.
There is no confirmed evidence that it does. Major AI search products have not said they use llms.txt for rankings or recommendations. It is harmless and inexpensive to add, but crawler access, structured data, clear content, and independent mentions matter more.
No. robots.txt tells crawlers which parts of a site they may visit. llms.txt suggests which content is most useful. If robots.txt blocks an AI crawler, llms.txt will not help.
Yoast SEO can generate a basic llms.txt under Settings, Site features. For more control, write a custom file, or generate one from your real pages with a small plugin, and make sure it loads at yoursite.com/llms.txt.
Want your business to show up in AI search?
Penner Web Design helps businesses in Durham, the Triangle, and beyond get found and recommended by AI answer engines: structured data, AI crawler access, answer-first content, llms.txt, and off-site signals. Learn about AI Search Optimization or read how to tell if ChatGPT recommends your business.
