Observed arrival · 2026-10-22
The Walled Web maps who blocks AI crawlers
An interactive tracker checks 170 major websites for rules that allow, limit, or block AI bots.
○Open
⊠Login
$Paid
†Ads
✦Pretty
●Pro
◎Niche
◉Human
⚑Risk
ƒJS
- For
- People tracking AI access to public websites
- Worth noticing
- Its tally separates written bot rules from whether its own crawler was admitted or challenged.
Field notes
The interface classifies sites by the rules they publish for named bots and separately records whether the project's own crawler could reach a homepage. Its month-by-month view reaches back to January 2023, with older records attributed to the Internet Archive. The project reports 11 sites whose rules it could not read and 19 homepages it could not visit, preserving those gaps rather than presenting complete coverage.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
○OpenPublic substance visible
✦PrettyNotable craft visible
●ProPolished or operationally mature
◎NicheUnusually specific use
One card from the complete issue