robots.txt for AI: how to let ChatGPT and Perplexity crawl your site

<p>robots.txt is a simple text file that tells web crawlers which parts of your site they can access. AI engines have their own crawlers: GPTBot for OpenAI, ClaudeBot for Anthropic, PerplexityBot for Perplexity.</p><h2>How to check your robots.txt</h2><p>Visit yoursite.com/robots.txt. Look for User-agent rules that block GPTBot, ClaudeBot, or PerplexityBot. Many CMS platforms block these by default.</p><h2>The fix</h2><p>Add explicit Allow rules for AI crawlers. BrandCited checks this automatically and tells you exactly which bots are blocked.</p>