Free tool

Can AI crawlers reach your site?

We read your robots.txt and answer for each of 13 AI crawlers. A blocked crawler means that AI never sees your site; every bit of content and schema work is wasted on it.

Our server reads only /robots.txt; it does not open any other page.

GPTBot
OpenAI · ChatGPT egitim ve tarama —

OAI-SearchBot
OpenAI · ChatGPT arama —

ChatGPT-User
OpenAI · kullanici istegiyle sayfa acma —

ClaudeBot
Anthropic · Claude —

Claude-Web
Anthropic · Claude web erisimi —

anthropic-ai
Anthropic · eski tanimlayici —

Google-Extended
Google · Gemini —

PerplexityBot
Perplexity —

Applebot-Extended
Apple Intelligence —

Bytespider
ByteDance —

CCBot
Common Crawl · bircok modelin veri kaynagi —

meta-externalagent
Meta AI —

Amazonbot
Amazon · Rufus / Alexa —

Crawler access is one of 19 checks.

The AI Readiness scan also measures the same site for llms.txt, schema, structure and authority; results in minutes.

Scan for free

llms.txt generator

Produces a ready-to-publish llms.txt from your company name, what you do and your key pages.

Open tool →

Schema.org generator

Produces Organization / LocalBusiness JSON-LD with address, phone and social profiles.

Open tool →