Observed arrival · 2026-10-11
CrawlerPulse maps which news sites block AI crawlers
An interactive tracker checks 12,716 news outlets across 227 countries for access rules affecting AI crawlers.
○Open
⊠Login
$Paid
†Ads
✦Pretty
●Pro
◎Niche
◉Human
⚑Risk
ƒJS
- For
- Researchers and newsrooms tracking AI crawler access
- Worth noticing
- It distinguishes Google-Extended from Google Search; the page says 15 times more outlets block the former.
Field notes
The dashboard separates crawler-level results from country and outlet-size comparisons, and includes views for individual publishers and changes between runs. Its size bands use the Tranco list; the country view leaves blank places with fewer than five measured outlets, while the largest-outlets table excludes Google Search from its crawler count.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
○OpenPublic substance visible
✦PrettyNotable craft visible
◎NicheUnusually specific use
One card from the complete issue