Skip to main content

What is GPTBot?

OpenAI · AI training · class ai

Collects pages that may be used to train OpenAI models. Blocking it does not affect ChatGPT search or browsing.

Verdict: Charge it or block it. It does not pay yet.

Profile

Compiled by Crawler Atlas from the operator's published documentation. Not yet declared by the operator. JSON

OperatorOpenAI · platform.openai.com
PurposeAI training crawlers. Collect pages to train models. Bulk, periodic, and the ones most owners want to charge or block.
User-agent containsgptbot
robots.txtUser-agent: GPTBot
Disallow: /
How to verifyThe operator publishes its address ranges: openai.com. A request that claims this name from an address outside these is an impostor.
Should you block it?Charge it or block it. It does not pay yet.
Does it pay?No. It does not carry a wallet and cannot answer a 402. A site that charges simply serves it nothing.
Docshttps://platform.openai.com/docs/bots

Observed on the network

Anonymous daily counts from sites running Pay-per-Crawl that opted in, plus the ForgeMesh fleet. Last 7 days. Small sample: 1 sites reporting.

Sites that saw it
1 of 1
Fetches
1
Impostor rate
0%
Paid fetches
0
Sites charging it
100%
Sites blocking it
0%
Median price
$0.05
First seen
2026-10-28

Do something about it

Also in ai training crawlers

ForgeMesh Crawler Atlas is maintained by ForgeMesh. Names and marks belong to their operators and are used to identify their crawlers.