Observed arrival · 2026-09-02
ProMe Puts Open Models on Trial
A Taiwanese project compares unmodified open-weight language models with its domain-enhanced versions through side-by-side, blind voting.
Field notes
The project compares each listed ProMe model with an otherwise matching base model, keeping parameter counts the same and using randomized left-right placement before revealing the model identity. Its current catalogue names Qwen3.8 27B, Gemma4 32B, and Qwen3-VL 32B, with INT4 quantization noted for the latter two entries. ProMe says its models run on project-owned GPU hardware rather than through a third-party API, and describes source checking and licensing review as part of its training-data workflow.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
One card from the complete issue