Featured in Domain Arrivals · 2026-08-11
BotsVisibility: See Which Crawlers Your Site Is Blocking
An open-source diagnostic that probes a URL with 80+ search, AI, SEO, directory, and social crawler user-agents.
Why it surfacedBotsVisibility reports which crawlers a host blocks, throttles, or sends noindex challenges to, with a serial mode designed to stay under common rate limits. Its specific origin story is unusually concrete: the creators say SiteGround’s default WAF blocked 16 of 23 AI crawlers on their sites.
Continue into the edition
Lunch Through the Bee Veil
August 11’s newborn domains include a bee veil with a lockable lunch flap, a book designed to unfold over ten years, a Colombian missing-person and aid board, and a brick studio made by a dad and his 10-year-old co-founder.
This is one of 1,000 discoveries in the 2026-08-11 Domain Arrivals issue.