# Ridge AI robots.txt # https://www.ridgedata.ai/robots.txt # Source of truth: ~/Code/gtm_agents/docs/agent-discovery/robots.txt User-agent: * User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: Google-Extended User-agent: Amazonbot User-agent: Bytespider User-agent: CCBot User-agent: PerplexityBot User-agent: Applebot-Extended User-agent: meta-externalagent Content-Signal: ai-train=yes, search=yes, ai-input=yes # Open site — every public path is crawlable. No Disallow rules by design: # only paths verified to exist should ever be listed, and there are none to block. Allow: / Sitemap: https://www.ridgedata.ai/sitemap.xml