Observed arrival · 2026-11-17
Probity tests the AI behind hiring tools
Probity describes recurring tests of AI hiring tools using fictional résumés to check scoring behavior, job criteria, and changes over time.
○Open
⊠Login
$Paid
†Ads
✦Pretty
●Pro
◎Niche
◉Human
⚑Risk
ƒJS
- For
- Vendors testing AI-assisted hiring tools
- Worth noticing
- Probity says its pre-registered public-model tests found hidden text shifted scores by about 14 points; it cautions these are not vendor-specific results.
Field notes
The described workflow accepts scores as a batch file or through an API and uses fictional résumés designed to probe one behavior at a time. Probity lists five test areas, including whether hidden text changes scores and whether behavior shifts after model, prompt, or hosting updates; the reported numerical findings are from its own public-model studies.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
○OpenPublic substance visible
⊠LoginAccess appeared gated
✦PrettyNotable craft visible
●ProPolished or operationally mature
◎NicheUnusually specific use
ƒJavaScriptBrowser-side code central
One card from the complete issue