BreakBot, a crash-test dummy for robot policies

Field notes

BreakBot queues versioned robot-policy jobs on a private RTX worker running NVIDIA Isaac Lab, then evaluates them across 32 repeatable seeds. Its current public example is a Franka manipulation task, with perturbations covering mass, friction, pose, actuator limits, latency, and controller choice. Each run is described as returning robustness, collision, timing, replay, and rendered H.264 evidence; the site also notes that the public benchmark may wait in a compute queue.