# llms.txt — guidance for AI crawlers # This file is intended to help LLM/AI crawlers understand your site's crawling policy. # Place at https://yourdomain.tld/llms.txt. This version is permissive to aid GEO/AIO # while blocking admin/editor areas. # Global policy User-agent: * Allow: / Disallow: /EPiServer/ Disallow: /util/ Sitemap: /sitemap.xml # Common AI-related crawlers User-agent: GPTBot Allow: / Disallow: /EPiServer/ Disallow: /util/ User-agent: Google-Extended Allow: / Disallow: /EPiServer/ Disallow: /util/ User-agent: CCBot Allow: / Disallow: /EPiServer/ Disallow: /util/ User-agent: anthropic-ai Allow: / Disallow: /EPiServer/ Disallow: /util/ User-agent: PerplexityBot Allow: / Disallow: /EPiServer/ Disallow: /util/