# robots.txt for https://www.grcranes.com/ # Purpose: maximize crawlability for traditional search + explicitly welcome # AI answer engines (AEO) and generative engines (GEO) so GR Cranes content # can be indexed, cited, and summarized across ChatGPT, Perplexity, Google AI # Overviews, Copilot, Gemini, Claude, and similar surfaces. # ── Default: allow everyone ───────────────────────────────────────────────── User-agent: * Disallow: /thank-you Disallow: /checkout Disallow: /quote-list Allow: / # ── Traditional search engines ────────────────────────────────────────────── User-agent: Googlebot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Bingbot Disallow: /checkout Disallow: /quote-list Allow: / # ── AEO / GEO — AI answer & generative search crawlers ────────────────────── # These power live citations in AI answers (ChatGPT search, Perplexity, # Copilot, AI Overviews) as well as model training/knowledge — allowing them # is what makes a site eligible to be cited as a source at all. User-agent: GPTBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: OAI-SearchBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: ChatGPT-User Disallow: /checkout Disallow: /quote-list Allow: / User-agent: ClaudeBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Claude-Web Disallow: /checkout Disallow: /quote-list Allow: / User-agent: anthropic-ai Disallow: /checkout Disallow: /quote-list Allow: / User-agent: PerplexityBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Perplexity-User Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Google-Extended Disallow: /checkout Disallow: /quote-list Allow: / User-agent: GoogleOther Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Applebot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Applebot-Extended Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Amazonbot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: meta-externalagent Disallow: /checkout Disallow: /quote-list Allow: / User-agent: FacebookBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Bytespider Disallow: /checkout Disallow: /quote-list Allow: / User-agent: CCBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: YouBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: DuckAssistBot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Diffbot Disallow: /checkout Disallow: /quote-list Allow: / User-agent: Timpibot Disallow: /checkout Disallow: /quote-list Allow: / # ── Sitemap ────────────────────────────────────────────────────────────────── Sitemap: https://www.grcranes.com/sitemap.xml