Free tool · Reads your real robots.txt · 16 bots
Can GPTBot access your site?
One check, sixteen verdicts: GPTBot, ClaudeBot, PerplexityBot and every major AI crawler — allowed or blocked, with the exact robots.txt rule that decides it.
Questions
- Can GPTBot access my site by default?
- Yes — if your robots.txt has no rule naming GPTBot (and no blanket Disallow under *), it can crawl you. Robots.txt is opt-out: silence means access. The checker above reads your actual file and tells you which rule applies.
- Which AI bots should I allow, and which can I block safely?
- Search/answer bots (OAI-SearchBot, PerplexityBot, Claude-SearchBot, DuckAssistBot) put you in AI answers — block them and you disappear from those answers. Training bots (GPTBot, CCBot, Bytespider, Google-Extended, Meta-ExternalAgent) collect content to train models — blocking them costs no answer visibility. Different bots, different trade-offs.
- I blocked GPTBot — am I gone from ChatGPT?
- Not necessarily. GPTBot feeds training; ChatGPT's live answers draw on OAI-SearchBot's index and ChatGPT-User fetches. If those two are allowed, you can still appear in ChatGPT Search answers with GPTBot blocked.
- Does robots.txt actually stop AI bots?
- The major companies (OpenAI, Anthropic, Google, Perplexity) publicly honor it. Anonymous scrapers may not — robots.txt is a convention, not a firewall. To see who actually visits regardless of rules, use live crawler analytics.
Rules say who MAY visit. See who actually DOES.
Live crawler analytics shows every real AI-bot visit — which bot, which page, when. Free while in beta.
Track real bot visits →