Beta pricing ends when monitoring launches. Current customers keep their price for 12 months. Lock it in →
AI Crawler Visibility audit
GPTBot, ClaudeBot, PerplexityBot and Google-Extended have to read your site before AI can recommend you. We check robots.txt rules, meta directives, headers and bot-protection walls that silently lock them out.
How does the AI Crawler Visibility audit work?
We check the same signals that block real crawlers
robots.txt rules, meta robots and X-Robots-Tag directives, response headers, and bot-protection or WAF behavior, tested for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot specifically, not a generic user agent.
A blocked crawler is a finding, not a pass
If a bot-protection service or CDN is silently returning a 403 to these crawlers, the audit reports it as a finding exactly like a missing meta tag. It's a common reason a business is invisible to AI search, and it often goes unnoticed because the site still looks fine to a human visitor.
The fix is a rewritten robots.txt and llms.txt, ready to use
Every blocked-crawler finding links to the fix generator that produces a corrected robots.txt and an llms.txt file describing what your business does, ready to drop in.
Generated robots.txt and llms.txt output.
What do you get with the AI Crawler Visibility audit?
- Crawler-by-crawler results for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot
- robots.txt, meta directive, and response header checks, not a single generic test
- Bot-protection and WAF walls flagged as findings when they block legitimate crawlers
- A corrected robots.txt and llms.txt generated from the findings
- The same crawler-access signal that feeds your AI Citation Score
- Re-check anytime to confirm a fix actually opened access
Which plans include AI Crawler Visibility?
| Plan | What's included |
|---|---|
| Pro | Included with every audit |
| Max | Included with every audit, plus early access to new dimensions |
| Agency | Included with every client audit |
| Enterprise | Included at usage limits scaled to your organization |
Full plan details, prices and the beta grandfather promise are on the pricing page.
Which AI crawlers do you actually test?
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot, the crawlers behind ChatGPT, Perplexity, Claude and Google's AI features. See how this fits the other 16 dimensions on the methodology page.
My site looks fine when I visit it. Can it still be blocking AI crawlers?
Yes, and it's common. Bot-protection services often let human browsers through while silently blocking anything that looks automated, including the crawlers your AI visibility depends on. That's exactly what this check exists to catch.
Do you fix a blocked crawler for me, or just report it?
Both start the same way: the audit flags it, then the fix generators produce a corrected robots.txt and llms.txt you apply yourself. See what all 18 fix generators produce.
Related: the methodology page · the fix generators · the AI Citation Score · plan details
See it on your own site.