Skip to main content

What is Googlebot?

Google · search index · class search

Indexes pages for Google Search. Blocking it removes you from Google.

Verdict: Let it in. Verify it.

Profile

Compiled by Crawler Atlas from the operator's published documentation. Not yet declared by the operator. JSON

OperatorGoogle · developers.google.com
PurposeSearch engines. Index pages for search results. Verified by reverse DNS and free by default; blocking them removes you from search.
User-agent containsgooglebot
robots.txtUser-agent: Googlebot
Disallow: /
How to verifyReverse DNS on the client address must end in .googlebot.com, .google.com and resolve forward to the same address. The operator publishes its address ranges: developers.google.com. A request that claims this name from an address outside these is an impostor.
Should you block it?Let it in. Verify it.
Does it pay?No. It does not carry a wallet and cannot answer a 402. A site that charges simply serves it nothing.
Docshttps://developers.google.com/search/docs/crawling-indexing/verifying-googlebot

Observed on the network

Anonymous daily counts from sites running Pay-per-Crawl that opted in, plus the ForgeMesh fleet. Last 7 days. Small sample: 1 sites reporting.

Sites that saw it
1 of 1
Fetches
5
Impostor rate
100%
Paid fetches
0
Sites charging it
100%
Sites blocking it
0%
Median price
$0.05
First seen
2026-10-28

Do something about it

Also in search engines

ForgeMesh Crawler Atlas is maintained by ForgeMesh. Names and marks belong to their operators and are used to identify their crawlers.