datascale
DE EN
Contact

Check explainer

AI bot policy

GPTBot, ClaudeBot, PerplexityBot decide whether your content shows up in AI answers, make a deliberate call.

  • note

What we check

Checks robots.txt for rules targeting GPTBot, ClaudeBot, PerplexityBot, and others.

Why it matters

GPTBot, ClaudeBot, PerplexityBot decide whether your content shows up in AI answers, make a deliberate call.

Common causes

The most common triggers for this finding. Expand this section with real-world examples.

How to fix it

Decide with marketing + legal, then add User-agent sections in robots.txt.

  • Q01
    What does a failing AI bot policy finding mean?

    GPTBot, ClaudeBot, PerplexityBot decide whether your content shows up in AI answers, make a deliberate call. Decide with marketing + legal, then add User-agent sections in robots.txt.

  • Q02
    How do you fix AI bot policy?

    Decide with marketing + legal, then add User-agent sections in robots.txt.

← Back to the Measurement Health Check