Loading MarketToolz engine...
Loading MarketToolz engine...
An /llms.txt file is a standardized, machine-readable Markdown file placed at the root directory of a website (https://yourdomain.com/llms.txt) that provides Large Language Models, AI search crawlers, and RAG agents with a concise summary of your brand, core capabilities, and canonical URLs without HTML navigation clutter.
2026 Industry Benchmark: Keep your root /llms.txt file between 500 and 3,000 tokens so it fits effortlessly inside real-time RAG retrieval windows.
Instead of forcing an LLM crawler to parse 150 KB of JavaScript and CSS menus, /llms.txt delivers your entire product hierarchy and canonical documentation links in under 2,000 clean tokens.
Launch the interactive calculators connected to this formula:
Generate a standard /llms.txt and /llms-full.txt markdown file so ChatGPT, Perplexity, and Claude index your site accurately.
Audit and generate robots.txt directives for OpenAI (OAI-SearchBot, GPTBot), PerplexityBot, ClaudeBot, and Google-Extended.
Audit your brand and domain visibility across ChatGPT Search, Google AI Overviews, Perplexity AI, Claude, Gemini, and Microsoft Copilot.
Generate customized robots.txt files with crawler directives and sitemap links.