Observed arrival · 2026-09-10
Ultrabench: The Mac Studio Has to Pay for Itself
A public local-LLM benchmark project built around a 512GB Mac Studio and an AI operator tasked with earning back its $15,000 cost.
Field notes
The project separates its pre-hardware work from its future measurements: the harness is currently validated on an M3 Max with 36GB, while the planned target is an M5 Ultra Mac Studio with 512GB of unified memory. Its proposed outputs include raw JSON, charts, and measurements for throughput, concurrency latency, power use, and quantization-related accuracy loss. A fallback to a 256GB configuration is specified if the larger machine slips past November.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
One card from the complete issue