Observed arrival · 2026-09-26

Two Webs checks the machine-facing page

twowebs.dev Visit website

Editorial interest 78/100 Selection signal · not a rating of the site

It compares a URL’s Chrome response with responses fetched under Googlebot, Bingbot, and 12 AI crawler and assistant user agents.

Landing page captured for the 2026-09-26 issue.

For: Site owners checking crawler access
Worth noticing: Its robots.txt evaluator follows RFC 9309 group precedence, longest-rule matching, and Allow-over-Disallow ties.

Field notes

The page describes separate live requests using crawler user-agent strings, alongside a robots.txt evaluator that checks 18 crawler tokens. It says its rule matching follows RFC 9309, including which group and rule take precedence, and also checks for llms.txt and llms-full.txt. The side-by-side example includes status, title, word count, robots access, and canonical information, but is explicitly marked illustrative.

Observed signals

Read the marks

Editorial observations of this landing page, not a rating.

○OpenPublic substance visible

✦PrettyNotable craft visible

●ProPolished or operationally mature

◎NicheUnusually specific use

One card from the complete issue

The Phone Disclosure Test

328,122 arrived 1,000 judged 977 catalogued Enter the complete issue