Guide
llms.txt for AI discovery and product docs
llms.txt is a plain text map for AI systems. It does not replace SEO, but it gives language models a clean summary of the product and important URLs.
llms.txtAI discoveryLLM SEOAI search optimization
What to include
Include the product name, a short description, core pages, important docs, use cases, and featured resources. Keep it direct and readable.
For Codex Skills, llms.txt points to the catalog, sitemap, Telegram bot, use-case pages, and featured skill pages.
What not to include
Do not paste every page into llms.txt. It should be a map, not a duplicate site. Link to canonical pages and let crawlers fetch the details.
How it fits with organic traffic
Classic search still depends on crawlable pages, titles, descriptions, internal links, and backlinks. llms.txt is an extra discovery layer for AI tools and answer engines.