Observed arrival · 2026-10-21
Waldo gives AI agents hands—and makes them ask first
A Mac tool that lets MCP-compatible AI agents inspect and operate app controls, with human approval gates for consequential actions.
- For
- Mac users connecting MCP-compatible AI agents
- Worth noticing
- It reads the macOS accessibility tree rather than relying on pixels, and offers a top-left-corner emergency stop.
Field notes
Waldo’s homepage describes an accessibility-tree workflow: controls are identified by name, role, and position, and the agent is told whether an action actually worked. The project says its approval panel accepts only a physical mouse click, while both the pointer-to-corner gesture and a typed stop command halt activity. Its reported figures include reading 241 controls in one Chrome window in 0.35 seconds; those measurements are presented by the project, not independently verified here.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
One card from the complete issue