What is Googlebot?
Google · search index · class search
Indexes pages for Google Search. Blocking it removes you from Google.
Verdict: Let it in. Verify it.
Profile
Compiled by Crawler Atlas from the operator's published documentation. Not yet declared by the operator. JSON
| Operator | Google · developers.google.com |
|---|---|
| Purpose | Search engines. Index pages for search results. Verified by reverse DNS and free by default; blocking them removes you from search. |
| User-agent contains | googlebot |
| robots.txt | User-agent: GooglebotDisallow: / |
| How to verify | Reverse DNS on the client address must end in .googlebot.com, .google.com and resolve forward to the same address. The operator publishes its address ranges: developers.google.com. A request that claims this name from an address outside these is an impostor. |
| Should you block it? | Let it in. Verify it. |
| Does it pay? | No. It does not carry a wallet and cannot answer a 402. A site that charges simply serves it nothing. |
| Docs | https://developers.google.com/search/docs/crawling-indexing/verifying-googlebot |
Observed on the network
Anonymous daily counts from sites running Pay-per-Crawl that opted in, plus the ForgeMesh fleet. Last 7 days. Small sample: 1 sites reporting.
- Sites that saw it
- 1 of 1
- Fetches
- 5
- Impostor rate
- 100%
- Paid fetches
- 0
- Sites charging it
- 100%
- Sites blocking it
- 0%
- Median price
- $0.05
- First seen
- 2026-10-28
Do something about it
- See it in your own logs, verify it, and charge, allow or block it by name with the free Pay-per-Crawl plugin (WordPress, Python, JavaScript, Go, PHP).
- Run this crawler? Publish a crawler-profile.json on your domain and this page shows your declared profile with a verified badge.
- Machine-readable twin: /bots/googlebot/profile.json (free in a browser). Machines: POST
{"slug":"googlebot"}to x402.forgemesh.io/bot-profiles, $0.005 per call over x402.
Also in search engines
Crawler Atlas is maintained by ForgeMesh. Names and marks belong to their operators and are used to identify their crawlers.