Your robots.txt is probably blocking the exact AI bots you need for citations — and you don’t know it.There are two kinds of AI bots: training crawlers (GPTBot, ClaudeBot, etc.) that collect data to build AI models, and search indexers (OAI-SearchBot, Claude-SearchBot, PerplexityBot) that drive live citations in Google AI Overviews, ChatGPT, Claude, and Perplexity.









