Observed arrival · 2026-08-29
Garrett Johnson Puts AI Receptionists on the Bench
A personal testing log that compares business AI tools through repeatable experiments, real costs, and practical judgments.
Field notes
The proposed benchmark standardizes the test environment around a fictional plumbing company with fixed hours, three service prices, and instructions to answer questions and book jobs. Four calls are planned for each service, including an after-hours emergency, while the listed products span free access through $199 per month. The page says results will also account for setup time, usage-based charges, overages, and the practical difficulty of cancelling.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
One card from the complete issue