What is Internet Archive?

Internet Archive · archive · class monitor

Wayback Machine. Non-profit preservation.

Verdict: Let it in if you value preservation; know where the corpus goes.

Profile

Compiled by Crawler Atlas from the operator's published documentation. Not yet declared by the operator. JSON

Operator	Internet Archive · archive.org
Purpose	Archives and research. Preservation and open corpora. Non-profit, but their datasets feed AI training downstream.
User-agent contains	`archive.org_bot · ia_archiver`
robots.txt	`User-agent: ia_archiver` `Disallow: /`
How to verify	No published verification method. Treat the name as a claim, not proof.
Should you block it?	Let it in if you value preservation; know where the corpus goes.
Does it pay?	No. It does not carry a wallet and cannot answer a 402. A site that charges simply serves it nothing.
Docs	https://archive.org/details/archive.org_bot

Anonymous daily counts from sites running Pay-per-Crawl that opted in, plus the ForgeMesh fleet. Last 7 days. Small sample: 1 sites reporting.

No sightings reported yet. Internet Archive appears here the day an opted-in site sees it.

See it in your own logs, verify it, and charge, allow or block it by name with the free Pay-per-Crawl plugin (WordPress, Python, JavaScript, Go, PHP).
Run this crawler? Publish a crawler-profile.json on your domain and this page shows your declared profile with a verified badge.
Machine-readable twin: /bots/internet-archive/profile.json (free in a browser). Machines: POST {"slug":"internet-archive"} to x402.forgemesh.io/bot-profiles, $0.005 per call over x402.

Crawler Atlas is maintained by ForgeMesh. Names and marks belong to their operators and are used to identify their crawlers.