Part of the AI Search series. For the full picture, start with Technical SEO and AI search readiness: the complete audit checklist.
ChatGPT search answers questions with links to the pages it used. For publishers, the question is how to be one of those pages. OpenAI’s own documentation is short, and most of the work is technical basics.
What does OpenAI say?
OpenAI’s publisher FAQ starts with the key point: “Any public website can appear in ChatGPT search.” And the one requirement it names: “For your site content to be included in summaries and snippets in ChatGPT, make sure you aren’t blocking OAI-SearchBot.”
There’s no submission process and no special markup. Being crawlable by the right bot is the entry ticket; being useful is what gets you cited.
Which crawler matters?
OpenAI documents three user agents (OpenAI crawlers):
| User agent | Used for | Effect of blocking |
|---|---|---|
| OAI-SearchBot | “To surface websites in search results in ChatGPT’s search features” | Blocked sites “will not be shown in ChatGPT search answers, though can still appear as navigational links” |
| GPTBot | Training data | Opts out of training; no effect on search |
| ChatGPT-User | Fetches during user actions | “robots.txt rules may not apply” |
So the common policy, opting out of training but staying in search, is: disallow GPTBot, allow OAI-SearchBot. OpenAI notes it “can take ~24 hours” for robots.txt changes to take effect. See how to block AI crawlers for the full robots.txt.
What should you check on your site?
- Robots.txt and CDN. OAI-SearchBot must be allowed in robots.txt and not blocked by bot protection. Test by crawling with an OAI-SearchBot user agent: Crawlens applies the robots.txt group matching the bot’s token, so disallowed URLs show as Blocked by robots.txt, and CDN blocks show up as 4xx or pages that did not respond.
- Content in the HTML. Vercel’s analysis of AI crawlers (December 2024) found that “none of the major AI crawlers currently render JavaScript.” Turn on Render JavaScript and check Content depends on JavaScript and Links only in rendered HTML. See JavaScript SEO.
- Errors and redirects. The same Vercel study found ChatGPT’s crawler spending a large share of fetches on 404s and redirects. Fix broken links and redirect chains.
- Server logs. Import logs into Crawlens: OAI-SearchBot and ChatGPT-User requests appear in the AI crawlers group, with how many returned 200. No requests at all usually means something upstream blocks them.
How do you opt out?
The FAQ is explicit: if you don’t want a page to appear, “use the noindex meta tag.” Blocking OAI-SearchBot in robots.txt also keeps content out of ChatGPT search answers, with the navigational-link exception above.
How do you measure ChatGPT traffic?
OpenAI says ChatGPT “automatically includes the UTM parameter utm_source=chatgpt.com in referral URLs.” In Google Analytics, ChatGPT visits also fall into the AI Assistant channel. See how to track AI search traffic.
For everything AI search engines need from a site, see the AI search readiness checklist.
Checklist
- OAI-SearchBot allowed in robots.txt and not blocked by the CDN or firewall
- GPTBot allowed or blocked by deliberate choice
- Main content and links present in the raw HTML
- No broken links or redirect chains wasting AI crawls
- Server logs show OAI-SearchBot requests returning 200
-
noindexonly on pages that shouldn’t appear - ChatGPT referrals tracked via
utm_source=chatgpt.com
Frequently asked questions
How do I get my website into ChatGPT search?
OpenAI says any public website can appear in ChatGPT search. Make sure robots.txt and your CDN don't block OAI-SearchBot, keep important content in the HTML, and keep pages fast and error-free.
Does blocking GPTBot remove my site from ChatGPT search?
No. GPTBot is OpenAI's training crawler. ChatGPT search uses OAI-SearchBot. You can block GPTBot to opt out of training and still allow OAI-SearchBot.
How do I stop my pages appearing in ChatGPT search?
OpenAI's publisher FAQ says to use the noindex meta tag if you don't want a page to appear. Blocking OAI-SearchBot in robots.txt also keeps your content out of ChatGPT search answers, though pages can still appear as navigational links.
How can I see traffic from ChatGPT?
OpenAI says ChatGPT adds utm_source=chatgpt.com to referral URLs. In Google Analytics, those visits also fall into the AI Assistant channel.