llms.txt Generator: tell ChatGPT, Claude, and Perplexity what to read
llms.txt is the emerging standard for telling LLM crawlers (ChatGPT, Claude, Perplexity, Gemini) what your site is about and which pages to read first. Paste your domain and we generate it for you. Free. No sign-up.
We fetch your sitemap, categorise URLs (Blog, Docs, Tools, Pricing…), pull title + meta from the top 60 pages, and assemble a markdown llms.txt ready to host at /llms.txt.
What is llms.txt?
A markdown file at /llms.txt that gives LLM crawlers a curated map of your site: categorized links with titles and descriptions. Think sitemap.xml, but LLM readable.
Why add llms.txt to your site now
OpenAI, Anthropic, and Perplexity have signalled they'll honour llms.txt as a discovery hint, and early adopters are getting cited more often in AI-generated answers. Without it, an AI crawler lands on your homepage and decides on its own what's worth reading, often missing your most important pages.
How to install your llms.txt file
Generate it above
Paste your domain, and we fetch your sitemap, categorise URLs and extract titles and metas from your top pages automatically.
Review and edit
Rename sections, remove pages you don't want AI to prioritize, and adjust descriptions.
Host it at /llms.txt
Upload via FTP, your CMS media library, or your deployment pipeline. Verify it's live at yourdomain.com/llms.txt (it should return plain text with a 200 status).
Track who actually cites your llms.txt
Now you have your llms.txt file — but are ChatGPT, Claude or Perplexity actually crawling your site and citing your brand in their answers? SEOcrawl's AI Tracker monitors brand citations across ChatGPT, Claude, Gemini and Perplexity, so you take your SEO a step further and close the loop on GEO.
Go to the App
FAQs
Is this llms.txt generator free?
Yes. You do not need an account or to add your email, and there is no "upgrade to see your file" wall. Paste your domain, copy the output, and host it. Done.
Which AI crawlers actually read llms.txt?
GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, and Bytespider have all signalled they honour llms.txt as a discovery hint. The spec lives at llmstxt.org and it's a community standard, not a Google or W3C requirement, which is worth knowing before you oversell it internally.
How is llms.txt different from robots.txt or sitemap.xml?
llms.txt gives LLM crawlers a curated, human-readable map with context about what each section of your site is actually for. The three files do different jobs, and you want all three for your site.
Does it work with WordPress or Shopify?
The generator fetches your sitemap directly; it doesn't touch your CMS. The output is a plain text file you upload to your root directory. One file, no plugin, works on any stack.
Is there an open source version?
This tool is a free web generator, nothing to install or clone. If you need API access or a self-hosted version, that's available inside the SEOcrawl platform.
What is llms.txt and why does it matter for SEO?
llms.txt is a plain text file that tells AI crawlers which pages on your site are worth reading and how your content is organised. As AI search grows (ChatGPT, Perplexity, Google AI Overviews), being crawlable and citable by LLMs is becoming as important as being indexable by Googlebot.
Will this improve my AI search visibility?
llms.txt helps AI crawlers find and understand your site. Early adopters are getting cited more in AI answers. But it's a discovery signal, not a confirmed ranking factor.
More Free SEO Tools
All free. No sign-up. Built by the SEOcrawl team.
