Free
llms.txt
Drop in a homepage URL and get a standards-compliant llms.txt file — title, summary, and categorized links for AI crawlers. No cookies. No account.
What it is
A concise site map for large language models
llms.txt tells AI systems what your site is about and where to find your most important pages. It is a lightweight markdown file at your domain root — easier for LLMs to parse than a full sitemap and more structured than raw HTML.
Output
What the file contains
- Site title
- Extracted from your homepage <title> tag.
- Summary
- One-line description from your meta description tag.
- Categorized links
- Internal pages grouped into meaningful sections from your sitemap.
- llmstxt.org format
- Standard markdown structure that LLMs and answer engines recognize.
How it works
Sitemap discovery, structured output
- 01
Homepage metadata
The generator reads your homepage title and meta description for the file header.
- 02
Sitemap crawl
Internal URLs are discovered from robots.txt, sitemap.xml, and sitemap indexes — same-host only, capped at 300 pages.
- 03
Categorization
Pages are grouped into named sections (Product, Blog, Docs, etc.) and rendered as a standards-compliant llms.txt file.
FAQ
Common questions
- What is llms.txt?
- llms.txt is a markdown file hosted at the root of your website (yoursite.com/llms.txt) that gives large language models a concise map of your site — a title, summary, and categorized links to your most important pages. It follows the llmstxt.org convention.
- How is this different from robots.txt or sitemap.xml?
- robots.txt tells crawlers what they may fetch. sitemap.xml lists URLs for search engines. llms.txt is written for LLMs and answer engines — human-readable markdown with context about what each section contains.
- What does the generator produce?
- A ready-to-publish llms.txt file with your site title and meta description at the top, followed by categorized links discovered from your sitemap. Page titles are inferred from URL slugs when needed.
- Where do I put the file?
- Upload llms.txt to your website root so it is accessible at https://yourdomain.com/llms.txt. On Next.js, place it in the public/ folder. On static hosts, upload to the document root alongside index.html.
- Is llms.txt generation free?
- Yes. The generator is free with no account required. Complete the verification step and download your file.