# Allow normal web crawlers User-Agent: Googlebot Allow: / # Disallow AI crawlers User-Agent: GPTBot Disallow: / User-Agent: CCBot Disallow: / User-Agent: ClaudeBot Disallow: / User-Agent: Google-Extended Disallow: / User-Agent: PerplexityBot Disallow: / User-Agent: FacebookBot Disallow: /