Observed arrival · 2026-10-14
A robots.txt checker for AI search conflicts
A free checker for publishers that inspects a site's robots.txt—or pasted rules—to flag when AI-training restrictions may also block AI-search citations, then offers copyable fixes.
○Open
⊠Login
$Paid
†Ads
✦Pretty
●Pro
◎Niche
◉Human
⚑Risk
ƒJS
- For
- Bloggers and small publishers
- Worth noticing
- It distinguishes training, search, and helper bots, and says unfamiliar bots will be listed as unknown rather than guessed at.
Field notes
The page presents four policy choices, from allowing search while denying training to blocking both, and says the preferred choice depends on whether a publisher wants to appear in AI answers. It distinguishes helper bots, which it describes as visiting when a person asks an AI tool to inspect a page, from training and search bots. The example conflict is explicitly labeled made up, not a real customer case.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
○OpenPublic substance visible
✦PrettyNotable craft visible
●ProPolished or operationally mature
◎NicheUnusually specific use
ƒJavaScriptBrowser-side code central
One card from the complete issue