Featured in Domain Arrivals · 2026-08-09
The Crawl Price Index
A weekly index tracking what websites charge—or do not charge—AI crawlers to read them.
Why it surfacedThe site catalogs observed pay-per-crawl prices, payment signals, and robots.txt block rates across the Tranco top 50,000. Its sharpest example is Stack Overflow quoting ClaudeBot USD 0.50 per crawl through Cloudflare’s pay-per-crawl system, while the paid feed offers per-domain data, weekly history, and API access.
Continue into the edition
Explicit Chemistry, Side A
August 9’s newborn domains include a wedding pressed into a playable record, an AI journal built across 62 memoryless sessions, 127,861 volunteer-verified license-plate-reader reports, and an eight-foot beach-wedding cross engineered for Gulf Coast wind.
This is one of 1,000 discoveries in the 2026-08-09 Domain Arrivals issue.