FoundGPTFoundGPTAI crawler list

Are you blocking AI crawlers?

Paste your store URL to see whether ChatGPT, Gemini, Perplexity and other AI engines can reach your site — or if your robots.txt is quietly locking them out. Free, no login.

Paste your store URL above to check which AI crawlers can reach it.

Why AI-crawler access matters

AI assistants read your store through crawlers. If your robots.txt (or your CDN) blocks the search and answer engines — GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Googlebot, Bingbot — those engines can't index or recommend you. Merchants often copy a "block AI bots" snippet meant for publishers protecting content, and accidentally lock out the very engines they want to be found by.

For what each crawler does, who runs it, and whether it obeys robots.txt, see the complete AI crawler & user-agent list.

What does this robots.txt checker do?

It fetches your store's robots.txt and reports which AI crawlers — GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Googlebot, Bingbot and more — are allowed or blocked from reaching your pages. Blocking the answer engines makes your store invisible in AI recommendations.

Which AI crawlers should a Shopify store allow?

Allow every search and answer engine your buyers use: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Googlebot and Bingbot. You can block training-only crawlers (Google-Extended, CCBot) separately without losing AI-answer visibility.

My robots.txt allows the crawlers but I'm still not cited — why?

A permissive robots.txt and a permissive edge configuration are not the same thing. A CDN or firewall bot rule (e.g. Cloudflare's block-AI-bots toggle) can return a 403 to a crawler your robots.txt technically allows. The full scan tests whether crawlers can actually reach you.