llms.txt Generator — make your site AI-discoverable

What is llms.txt?

llms.txt is a proposed standard by Answer.AI that tells AI assistants what content your website offers and how to use it. Think of it as robots.txt for AI — a simple plain-text file that helps large language models (LLMs) discover, understand, and reference your pages.

When an AI assistant like Claude, ChatGPT, or a custom agent visits your site, it automatically checks for a /llms.txt file. If found, the AI reads the file to learn which pages are important, what each page contains, and how to cite your content. Without llms.txt, AI assistants must guess which pages matter — and many may skip your content entirely.

The format is intentionally simple: a plain-text file with a title, description, and list of key pages. No XML, no complex markup. Just the information AI needs to reference your work accurately.

Why llms.txt matters for your site

AI assistants are becoming primary interfaces for finding and consuming information. Users increasingly ask ChatGPT, Claude, Perplexity, and custom AI agents to research topics, answer questions, and summarize content. If your site doesn't have an llms.txt file, you risk being invisible to these AI-driven discovery channels.

• AI discoverability — llms.txt gives AI assistants a clear map of your content, ensuring your most important pages are found and referenced.
• Accurate citations — Without llms.txt, AI models may cite outdated, less relevant, or incorrect pages. llms.txt directs them to your best content.
• Structured context — You control the description and section organization, helping AI understand your site's purpose and structure at a glance.
• Competitive advantage — Most sites don't have llms.txt yet. Adding it now positions your content ahead of competitors when AI assistants index the web.
• Future-proofing — As AI agents become more autonomous, llms.txt is likely to become as standard as robots.txt or sitemap.xml for web publishing.

llms.txt format

The llms.txt format is straightforward. Here's the structure:

# Title of your site
## Description
A brief description of what your site offers.

## Section Name
- Title: https://example.com/page: Brief description
- Another Page: https://example.com/other: What this page covers

## Another Section
- Page Title: https://example.com/page2: Description of content

Rules for formatting:

• The file starts with a # title line (level-1 heading)
• Use ## for the description (single line under ## Description)
• Use ## for section headings to group related pages
• Each entry is a bullet point with Title: URL: Description
• Lines starting with # are comments (ignored by parsers)
• Blank lines separate sections for readability
• Host the file at the root of your domain: https://yoursite.com/llms.txt

llms.txt vs sitemap.xml vs robots.txt

These three files serve different purposes for web discovery. Here's how they compare:

The three files work together: robots.txt controls who can crawl, sitemap.xml tells search engines what pages exist, and llms.txt tells AI assistants what content matters and why. All three should be present on a well-configured site.

Best practices

1. Keep it concise — Include only your most important pages. A good llms.txt has 10–30 entries, not hundreds. AI assistants work better with focused, curated lists.
2. Prioritize high-value pages — List pages that provide the most useful information: documentation, guides, product pages, and key blog posts. Skip thin or duplicate content.
3. Use descriptive titles — Each entry's title should clearly describe the page content. "Getting Started Guide" is better than "Page 1." AI uses these titles to decide which pages to cite.
4. Update when content changes — Treat llms.txt like sitemap.xml. When you add or remove important pages, update your llms.txt to keep AI assistants pointing to current content.
5. Include multiple sections — Group related pages under section headings (e.g., "Documentation," "API Reference," "Blog"). Sections help AI assistants understand the structure of your site at a glance.

Validator

Once you've generated your llms.txt below, you can validate it by checking these requirements:

• The file must start with a # Title line
• Each section heading must use ## format
• Each entry must follow the pattern - Title: URL: Description
• All URLs should be absolute (starting with https://)
• The file should be accessible at https://yoursite.com/llms.txt

Use the tool below to generate your llms.txt, then copy the result, save it as llms.txt, and upload it to the root of your domain. Test that it's accessible by visiting https://yoursite.com/llms.txt in a browser.

# My Company
> A platform that helps teams build better products

/	Home page
/pricing	Pricing information
/docs	Documentation
/blog	Blog posts