Skip to main content
Back to blog
AEOPublished 2026-05-22·4 min read·Pavan

What Is llms.txt and Why Your Website Needs One in 2026

llms.txt is a simple markdown file that tells AI crawlers exactly what your brand does, which pages matter, and how to represent you accurately. Here is what it is and how to create one in minutes.

llms.txt is a plain-text markdown file you place at yourdomain.com/llms.txt that tells AI systems (ChatGPT, Claude, Gemini, Perplexity) what your brand does, which pages are important, and how to describe you accurately. Think of it as robots.txt, but for AI assistants instead of search crawlers. The spec is maintained at llmstxt.org and is deliberately simple to implement.

Stylized illustration of a document file labeled llms.txt with AI system icons pointing toward it, on a dark background with brass gold accents

Why llms.txt matters for AI visibility

AI assistants do not read your entire website every time someone asks about your category. They work from crawled snapshots, training data, and structured context files when they exist. Without structured guidance, an AI might describe your brand based on a three-year-old press release, a competitor comparison post, or nothing at all.

llms.txt gives AI systems a direct, authoritative source. You control the brand name, the one-sentence description, the key pages worth citing, and the contact or social links that establish credibility. That is the difference between an AI saying "Markiqo is a marketing analytics platform" (wrong) and "Markiqo measures how AI assistants describe and recommend your brand" (right).

What the spec requires

The llms.txt specification is deliberately minimal:

  • An # H1 with your brand name at the top
  • A > blockquote with a one-sentence tagline immediately after
  • An optional ## About section with a short description
  • A ## Key Pages section listing your most important URLs with brief descriptions
  • Optional sections for contact, social, legal

The whole file is valid markdown. It is human-readable and machine-parseable. Here is the minimum viable version:

# Acme Corp

> B2B software that automates invoice reconciliation for finance teams.

## About
Acme Corp helps finance teams eliminate manual invoice matching. Founded in 2021, serving 400+ mid-market companies across the US and EU.

## Key Pages
- [Home](https://acme.com/): Overview of the platform and core use cases.
- [Pricing](https://acme.com/pricing): Plans and pricing for teams.
- [Blog](https://acme.com/blog): Guides on finance automation and AP workflows.

That is it. Place it at https://yourdomain.com/llms.txt and AI crawlers can find it.

How to create yours in minutes

You do not need to write it by hand. Markiqo's free LLMs.txt Generator does the heavy lifting:

  1. Enter your website URL: it pulls your sitemap and scrapes page titles and meta descriptions automatically
  2. Fill in your brand name and a one-sentence tagline
  3. Review the imported pages, edit descriptions, add or remove any pages
  4. Copy or download the generated file, then upload it to your site root

The whole process takes under five minutes. No account required.

Where to place the file

Your hosting platform determines how you deploy it:

  • Next.js: Drop llms.txt into the /public folder. It becomes available at yourdomain.com/llms.txt on next deploy.
  • Webflow: Use the "Custom Code" or file upload feature in Site Settings.
  • WordPress: Upload via FTP or your hosting file manager to the public_html root.
  • Any static host (Netlify, Vercel, Cloudflare Pages): Add llms.txt to your project root or public/ directory.

After deploying, verify it by visiting yourdomain.com/llms.txt in your browser. If you see your markdown content, it is live.

Frequently asked questions

Is llms.txt an official standard? It is a community-driven spec at llmstxt.org. It is not a W3C or IETF standard, but adoption has grown steadily since its introduction and many companies including Cloudflare and Anthropic have published their own.

Does it replace robots.txt or sitemap.xml? No. It works alongside them. robots.txt controls crawler access, sitemap.xml helps search indexing, llms.txt provides brand context to AI systems.

Will AI assistants actually read it? It depends on the AI system and whether it crawls the web. The value is in being prepared as crawler support grows, and in having a single authoritative source for how your brand should be described. The cost of adding one is five minutes.

How often should I update it? When your core positioning changes, when you add major new pages, or when you update your tagline. It is not a high-maintenance file.


If you want to see how AI assistants are currently describing your brand, request a free AI brand audit. We run your brand through ChatGPT, Gemini, Claude, and Perplexity and show you exactly what they say.


Pavan is a co-founder of Markiqo, an AI brand intelligence platform that measures how ChatGPT, Claude, Gemini, Perplexity, and Google AI Overview describe and rank brands. Last updated May 2026.

Continue reading

Markiqo

Want to see how AI describes your brand?

Get a report with your top narrative gaps and prioritized fixes.

Get Started