User-agent: * Disallow: /_api/ Disallow: /_partials Disallow: /cgi-bin/ # Explicitly allow major search engines User-agent: Googlebot Disallow: User-agent: Bingbot Disallow: User-agent: Applebot Disallow: # Explicitly allow AI crawlers User-agent: OAI-SearchBot Disallow: User-agent: ChatGPT-User Disallow: User-agent: ChatGPT-Feedback Disallow: User-agent: GPTBot Disallow: User-agent: PerplexityBot Disallow: User-agent: ClaudeBot Disallow: User-agent: CCBot Disallow: Sitemap: https://www.grahamsfoundation.org/sitemap.xml