# The Path. # Search result pages are marked noindex rather than blocked, so crawlers can see that instruction. # AI training: each of these is a vendor token for training, separate from its search crawler. # This is a request; robots.txt cannot enforce it or guarantee content is never used for training. User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Amazonbot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: CCBot Disallow: / User-agent: * Content-Signal: search=yes, ai-train=no Allow: / Sitemap: https://thepathguides.com/sitemap.xml