Crawler

ProtanAIBot

If you saw this crawler on your site, someone measured your site's AI visibility through protan.ai. Below is what it does, what it does not do, and how to stop it.

User-agent ProtanAIBot/1.0 (+https://protan.ai/bot)
Rate limit At most 1 request per second per host
Paths it reads / · /robots.txt · /llms.txt · /sitemap.xml
Method GET only. It submits no forms, signs in nowhere and writes nothing.
Timeouts Connect 5 s · total 15 s · at most 5 MB

How to stop it

two lines in robots.txt are enough

User-agent: ProtanAIBot
Disallow: /

Once you add this rule your site is not crawled. We do not work around it; a crawler that ignores robots.txt is doing something the AI engines we measure do not do either.

One thing worth knowing: a robots.txt that blocks everyone with User-agent: * blocks GPTBot and ClaudeBot too. If you want to stop us, write a rule for us alone as shown above; a blanket block wipes out your visibility inside the AI engines.

If you have a question or a complaint, write to us. We can find the scan record and tell you what happened.