AI crawler checker
Paste a URL. It reads the page and its robots.txt, then tells you which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and others) can get in, and what else makes the page hard for them to read.
Paste a URL. It reads the page and its robots.txt, then tells you which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and others) can get in, and what else makes the page hard for them to read.
/robots.txt, then evaluates bot access for the current path.If GPTBot, ClaudeBot, or PerplexityBot are blocked, confirm that this is intentional and aligned with your GEO policy.
Even if bots are allowed, weak metadata or missing structured data can reduce machine readability.
If the HTML response contains very little readable text, important content may be hidden behind client-side rendering.
Run a live analysis to see AI crawler access status, machine-readability signals, and likely GEO issues.
No page analysis yet.
No robots.txt analysis yet.