If you've searched for your brand in ChatGPT and found nothing — you're not alone. According to Cloudflare's 2025 AI crawler report, up to 30.6% of all web traffic may be AI crawlers, yet many sites block them unintentionally.
The 5 reasons ChatGPT ignores your content
1. GPTBot is blocked in robots.txt (most common)
ChatGPT uses GPTBot to crawl the web. If your robots.txt contains:
User-agent: GPTBot
Disallow: /
...then ChatGPT cannot read your site.
2. You have noai meta tags
Some content management systems add noai tags by default. Check your page source:
<meta name="robots" content="noai, noimageai">
This explicitly blocks all AI crawlers, including GPTBot.
3. Missing structured data (schema)
ChatGPT prefers pages with clear schema markup. Without FAQPage, HowTo, or Article schema, your content is harder to extract.
4. Low domain authority
ChatGPT's training prioritises authoritative sources. If your domain has few quality backlinks, you may be filtered out.
5. Content is too new or never updated
GPT's training data has a cutoff. Very recent content may not be included. Regular updates help.
Cloudflare's AI crawler data (2025)
Cloudflare analysed AI crawler traffic and found:
- 30.6% of web traffic may be AI crawlers (including GPTBot, ClaudeBot, Google-Extended)
- Many site owners unknowingly block these crawlers through security rules
- AI crawler traffic increased 450% year-over-year
How to diagnose your site
Run UltraScout's free AI SEO Score — it checks:
- Whether GPTBot is allowed in robots.txt
- Presence of
noaimeta tags - Structured data completeness
- Overall AI visibility score
How to fix it (step by step)
- Allow GPTBot in robots.txt:
User-agent: GPTBotthenAllow: / - Remove
noaimeta tags from key pages - Add FAQPage schema using JSON-LD
- Update content regularly (at least quarterly)
- Build quality backlinks to increase authority
Check your AI SEO Score — free, instant, no sign-up required
Get My Free AI SEO Score → View Full Audit Report