Osmium: The Marketplace That Publishes AI Failures

Field notes

The homepage divides evaluation into three named labs: Helios covers hallucination, citations, calibration, and refusal behavior; Astatine covers injection, leakage, and exfiltration; Nebula covers concurrency, latency, degradation, and recovery. It presents Aegis as the destination for immutable lab records, while sample marketplace entries include scores, deployment totals, and prices. Several counters remain in a loading state, so the page reads partly as a working product surface and partly as an announced operating model.