Perplexity AI uses a crawler called PerplexityBot to fetch live web content for its answers. Unlike some AI models that rely on training data, Perplexity always retrieves current information.
Perplexity AI serves over 780 million monthly searches. If PerplexityBot is blocked, your content will never appear in Perplexity answers — regardless of authority or relevance.
Visit https://yoursite.com/robots.txt and search for:
User-agent: PerplexityBot
Disallow: / — BlockedAllow: / — AllowedUltraScout's free AI SEO Score instantly scans your robots.txt and shows:
Add to your robots.txt:
User-agent: PerplexityBot
Allow: /
Place this before any global User-agent: * rules.
User-agent: PerplexityBot
Disallow: /
| Property | Value |
|---|---|
| User-agent string | PerplexityBot |
| Purpose | Live web search for Perplexity AI answers |
| Rate limits | Respects Crawl-delay directive |
Check your AI SEO Score — free, instant, no sign-up required
Get My Free AI SEO Score → View Full Audit Report