Observed arrival · 2026-09-24
SmartCode’s adversarial test runs
A senior-engineer-directed testing agent probes code written by coding agents, using skill packs to produce reproducible findings and failing tests.
- For
- Teams using coding agents on software systems
- Worth noticing
- Its sample says 18 of 200 parallel runs hit a lost-update race, with request traces and a failing test attached.
Field notes
The page describes an engagement that starts by mapping a system and agreeing on its promises, then assembling an engineer-reviewed skill pack before testing a disposable clone with synthetic data. Its defect taxonomy ranges from authorization gaps and prompt injection to migrations and tests that pass without proving behavior. A billing example also points out that the function returns success when the account is missing.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
One card from the complete issue