# robots.txt for GoBebop User-agent: * Allow: / # AI inference bots — allowed for AEO (these power real-time answers in ChatGPT, Claude, Gemini, etc.) # Note: some also use crawls for training; that's the tradeoff for being cited in AI answers. # Training-only / scraping bots — no inference value, blocked to manage egress User-agent: CCBot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / Sitemap: https://gobebop.app/sitemap.xml