llms.txt Generator & Checker
Build an llms.txt file with validated links and export only when it parses cleanly, or check any live URL: real structural validation against the llmstxt.org proposal, typed delivery states, and a link audit. Honest, dated evidence instead of AI SEO promises.
Enter a site name to start - Upload to your site root, next to robots.txt: yoursite.com/llms.txt.
- It must return HTTP 200 as plain text, not an HTML page.
- Curate: 10 to 30 strong links beat a dump of every URL.
- WordPress? Snippets for .htaccess and functions.php are below.
Fetches llms.txt from the EXACT origin you enter (scheme and port preserved; a full .../llms.txt URL is checked as-is) and parses it against the llmstxt.org proposal. Limit: 20 checks per minute.
What llms.txt is, and what it is not
llms.txt is an emerging convention, proposed at llmstxt.org, for a Markdown file that sits at your site root and tells AI assistants what your site is and which pages matter. AI companies may read it, and some tools already do, but nobody is obligated to. It is not a Google ranking factor, it does not block or allow crawlers, and publishing one does not guarantee your content appears in AI answers.
So why generate llms.txt at all? Because it is cheap: the file takes minutes to create, costs nothing to host, and when an agent or tool is pointed at it, you present curated, accurate content instead of whatever a scraper happened to grab. Just hold the claim at that: a proposed machine-readable content map, useful when something reads it.
- Confirmed: llms.txt is a public proposal (llmstxt.org, 2024) with a defined Markdown structure; various developer tools and some crawlers fetch it.
- Measured: Ahrefs (May 2026, 137,210 analytics-enabled domains) found 28% published an llms.txt, and 97% of those files received no requests during the measured month.
- Unknown: no major AI platform has publicly committed to reading the file, and there is no evidence it affects rankings anywhere.
robots.txt vs sitemap.xml vs llms.txt
Three root-level files, three different audiences. robots.txt restricts, sitemap.xml enumerates, and llms.txt curates. The first two are established; llms.txt is a young proposal whose adoption by AI platforms is still unproven.
| File | Audience | Format | Enforcement |
|---|---|---|---|
| robots.txt | Search and AI crawlers | Plain-text directives: User-agent, Disallow, Allow | Voluntary standard, honored by all major crawlers |
| sitemap.xml | Search engine crawlers | XML list of URLs with lastmod and priority hints | A discovery hint, not a command; crawlers pick what to use |
| llms.txt | AI assistants and LLM tools | Markdown: H1 name, blockquote summary, H2 link sections | Emerging convention, read at each AI tool’s discretion |
Add llms.txt to WordPress
The simplest route: download the file from the generator above and upload it to your site root, the same folder where robots.txt lives, using SFTP or your host's file manager. If your host does not let you write to the root, upload llms.txt to your uploads folder instead and serve it from the root with one of these snippets.
.htaccess (site root)RewriteEngine On RewriteRule ^llms\.txt$ /wp-content/uploads/llms.txt [L]functions.php alternative
add_action('init', function () {
$path = parse_url($_SERVER['REQUEST_URI'] ?? '', PHP_URL_PATH);
if ($path === '/llms.txt') {
$file = wp_upload_dir()['basedir'] . '/llms.txt';
if (is_readable($file)) {
header('Content-Type: text/plain; charset=utf-8');
readfile($file);
exit;
}
}
}); Either way, verify with the checker above: the file should return HTTP 200 with a plain-text body, not an HTML page.
Measure AI visibility instead of guessing at it
A growing share of discovery happens inside AI assistants: people ask ChatGPT, Perplexity, Claude or Gemini and click the sources those answers cite. Whether an llms.txt file contributes anything to that is currently unproven, which is exactly why measurement beats faith: the one thing you can verify is whether anything actually fetches your file and which AI crawlers and referrers touch your site.
You cannot manage AI visibility if you cannot see it. Which AI crawlers actually fetch your pages? Which AI assistants send you real visitors, and which "visits" are just bots? DevDome Analytics identifies AI crawlers and referrers by name and splits humans from bots on every metric, so you know whether your AI SEO work is paying off.
llms.txt FAQ
What is llms.txt?
llms.txt is a plain Markdown file at the root of your site (yoursite.com/llms.txt) that gives AI assistants a curated map of your most important content. Proposed at llmstxt.org in 2024, it follows a strict structure: an H1 with the site name, a blockquote one-line summary, optional detail paragraphs, then H2 sections containing markdown link lists.
Does llms.txt improve Google rankings?
No. llms.txt is not a Google ranking factor, and Google has said it does not use the file. Its value is elsewhere: it is a cheap, low-effort way to hand clean, curated content to the AI tools that do read it. Think of it as insurance for AI visibility, not as a traditional SEO lever.
Do AI companies actually read llms.txt?
Some do, many do not, and none guarantee it. A number of AI crawlers and developer tools fetch llms.txt files, and thousands of documentation sites already publish one. It is an emerging convention: adopting it costs a few minutes, and if AI tools in your niche read it, you show up with the content you chose instead of whatever they scraped.
Where do I put the llms.txt file?
At the root of your domain, next to robots.txt: https://yoursite.com/llms.txt. It must be served as plain text with a 200 status. Subdirectory locations are not part of the convention, so tools will not look anywhere else.
What is the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they may not fetch. llms.txt tells AI tools what they should read first. One is an exclusion protocol, the other is a curation format. They do different jobs, complement each other, and live side by side in your site root.
How do I add llms.txt to WordPress?
Generate the file with this llms.txt generator, then upload it to your site root next to robots.txt using SFTP or your host’s file manager. If you cannot write to the root, upload it to the uploads folder and serve it with the .htaccess rewrite or the functions.php snippet shown on this page.
What is llms-full.txt?
A companion convention. While llms.txt is a curated index of links, llms-full.txt inlines the full content of those pages into one large Markdown file so an AI tool can ingest everything in a single request. It is optional, and most sites start with llms.txt alone.
More free tools: WordPress robots.txt Generator · robots.txt Tester · Bot User-Agent Lookup · XML Sitemap Generator · Meta Tag Checker