omiGeo
Guide

How to allow GPTBot and AI crawlers in robots.txt

Step-by-step robots.txt rules for GPTBot, ClaudeBot, PerplexityBot, and Googlebot.

omiGeo Updated 2026-07-21

If AI crawlers are blocked, assistants may never retrieve your pages to cite them.

User-agent: *
Allow: /

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

Sitemap: https://yourdomain.com/sitemap.xml

Then re-scan with omiGeo to confirm the crawler matrix.

Ready to check your GEO score?

Free preview in seconds — unlock the full report when you need the fix plan.

Scan your site free