Model trainingYour call — not scored
GPTBot
Collects content to train future OpenAI models. Separate from search: blocking it does not remove you from ChatGPT search.
- robots.txt token
GPTBot- Operator
- OpenAI ↗
- Powers
- OpenAI model training
- Honours robots.txt
- Yes, documentedDocumentation ↗
Allow it
User-agent: GPTBot
Allow: /Block it
User-agent: GPTBot
Disallow: /Need the whole file, with every crawler and your private paths — and the llms.txt to go with it? The generator writes them. AI config generator →
User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.2; +https://openai.com/gptbot; Crawlable/1.0; +https://crawlable.fr/probeThis is the string we send when probing. The Crawlable suffix identifies us in your logs.
OpenAI
Check your own site
robots.txt is only half the answer: your CDN can refuse GPTBot before it ever reads the file. A scan checks both.
Free, no account, about 5 seconds.