User-agent: GPTBot: The robots.txt Block to Copy, and Every OpenAI Crawler Explained
User-agent: GPTBot controls whether OpenAI may train on your pages, not whether ChatGPT shows your store. Here is the robots.txt block to paste and what each OpenAI user-agent does.
User-agent: GPTBot is the robots.txt line that controls whether OpenAI may use your pages to train its models. It does not control whether ChatGPT shows your store in search or shopping answers. That is OAI-SearchBot. Here is the exact block to paste, and what each OpenAI user-agent does.
User-agent: GPTBot, the copy-paste block
If you landed here searching for user-agent: gptbot, this is the block most Shopify stores want. It keeps you visible in ChatGPT answers and leaves the training decision to you:
# ChatGPT search and shopping answers: keep this open
User-agent: OAI-SearchBot
Allow: /
# Model training: change to "Disallow: /" to opt out of training only
User-agent: GPTBot
Allow: /
That is the whole decision. User-agent: GPTBot followed by Disallow: / tells OpenAI not to use your content for training. It does nothing to your ChatGPT search visibility, because OpenAI treats the two settings as independent (OpenAI crawler docs). Blocking OAI-SearchBot is the line that removes you from ChatGPT search answers.
OpenAI also notes that search results can take about 24 hours to reflect a robots.txt change, so don't expect an instant effect either way.
Every OpenAI user-agent, and what it does
OpenAI's crawler documentation currently lists four user-agents. The version numbers below are the examples OpenAI publishes and they change over time, so always match on the token (for example GPTBot), never the full string.
GPTBot: model training.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot
GPTBot crawls content that may be used to train OpenAI's foundation models. Disallowing it is a defensible choice if you don't want your copy used for training, and it costs you nothing in ChatGPT search.
OAI-SearchBot: ChatGPT search and shopping surfacing.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot
This is the one a store should care about most. OpenAI says sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. Note the newer string starts like a normal Chrome browser, so log filters that look for Mozilla/5.0 AppleWebKit at the start will miss it. Match on OAI-SearchBot.
ChatGPT-User: live fetches a person triggers.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
ChatGPT-User visits a page when someone asks ChatGPT or a custom GPT a question that needs it. It is not an automatic crawler, and because the request comes from a user action, OpenAI says robots.txt rules may not apply to it. It also isn't used to decide what appears in search, so a ChatGPT-User rule is not how you manage search visibility.
OAI-AdsBot: ChatGPT ads landing pages.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbot
OAI-AdsBot only visits pages submitted as ads on ChatGPT, to check them against policy and judge relevance. OpenAI says its data is not used for training. If you never run ChatGPT ads, you won't see it.
For the full list beyond OpenAI (PerplexityBot, Google-Extended, ClaudeBot and others), see our AI crawler user-agents list.
The mistake that makes stores invisible
Most "block AI crawlers" advice treats every OpenAI bot as one thing. A merchant pastes a rule that disallows all of them, feels protected, and has quietly asked ChatGPT not to show the store in search answers.
- Disallowing GPTBot stops training use. Fine if that's what you want.
- Disallowing OAI-SearchBot removes you from ChatGPT search answers. Almost never what a store wants.
- A wildcard
User-agent: *withDisallow: /catches every bot that has no group of its own, including OAI-SearchBot.
You can decline training and still be fully visible in answers, but only if you keep the groups separate. If you're not sure why a store doesn't show up at all, our guide on why a Shopify store is invisible to AI walks through the other causes.
Where to put this on Shopify
Shopify generates robots.txt for you. To add rules, you edit the robots.txt.liquid template in your theme, which Shopify documents on shopify.dev. Add the OpenAI groups there rather than replacing the defaults, so you keep Shopify's own rules for checkout and cart pages.
Check what your store actually allows
robots.txt is easy to get subtly wrong: a broad Disallow higher up, a wildcard group, or a leftover rule from an SEO app. The only reliable test is to check each bot by name.
- Test your robots.txt per crawler: it shows whether GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, Googlebot and others can reach you.
- Run a free AI-readiness scan: crawler access is one of the checks that decide whether ChatGPT can read, and recommend, your products.
Frequently asked questions
What does "User-agent: GPTBot" mean in robots.txt?
It starts a group of rules that apply only to GPTBot, OpenAI's training crawler. The Allow or Disallow lines under it tell GPTBot which paths it may crawl for content that could be used to train OpenAI's models.
Does blocking GPTBot remove my store from ChatGPT?
No. OpenAI treats GPTBot and OAI-SearchBot as independent settings. Blocking GPTBot opts you out of training. To stay in ChatGPT search answers, keep User-agent: OAI-SearchBot set to Allow: /.
What is the difference between GPTBot and OAI-SearchBot?
GPTBot gathers content that may be used to train OpenAI's models. OAI-SearchBot indexes sites so ChatGPT can show and link to them in search answers. A store can disallow the first and allow the second.
Can I block ChatGPT-User with robots.txt?
OpenAI says ChatGPT-User fetches are started by a person's request, so robots.txt rules may not apply to them. It also isn't used for search, so manage search visibility with OAI-SearchBot instead.
How long does a robots.txt change take to affect ChatGPT search?
OpenAI says it can take about 24 hours from a robots.txt update for its search systems to adjust.
How do I check whether my Shopify store blocks GPTBot or OAI-SearchBot?
Paste your store URL into the FoundGPT robots.txt checker. It reads your live robots.txt and reports access for each AI crawler by name.
FoundGPT helps Shopify stores get read, recommended and sold by AI engines. Start with a free AI-readiness scan.