Baseline
Label prior
Ranks 8 of 8 on noul, 8 of 8 on choice, =1 of 8 on score. A reference point, not a model.
0.0Decision Score
Rank 8 of 8
- Accuracy
- 62.0%
- Calibration gap
- 0.0
- Hand-off at 95%
- —
- $ per 1k
- —
- Speed p95
- —
0.0Decision Score
Rank 8 of 8
- Accuracy
- 1.3%
- Calibration gap
- 0.0
- Hand-off at 95%
- —
- $ per 1k
- —
- Speed p95
- —
0.0Decision Score
Rank =1 of 8
- Accuracy
- 41.7%
- Calibration gap
- 0.0
- Hand-off at 95%
- —
- $ per 1k
- —
- Speed p95
- —
Details
noul
Accuracy62.0%95% range 56.7–67.3%
Calibration gap0.0 ptslower is better · 0.0% of answers at confidence 1.00
Automation at 95%—no probabilitiesshared gate ≥ 0.91: acts on 0%
Speed—median · p95 —
Stability0.0%of answers change on an identical rerun
Valid output100.0%0.0% refused · 1,500 of 1,500 answered
Setupconstant probabilities · reasoning — · temperature — · 300 items × 5 runs
choice
Accuracy1.3%95% range 0.3–2.7%
Calibration gap0.0 ptslower is better · 0.0% of answers at confidence 1.00
Automation at 95%—no probabilitiesshared gate ≥ 0.96: acts on 0%
Speed—median · p95 —
Stability0.0%of answers change on an identical rerun · 0.0% change when options are reordered
Valid output100.0%0.0% refused · 1,500 of 1,500 answered
Setupconstant probabilities · reasoning — · temperature — · 300 items × 5 runs
score
Accuracy41.7%95% range 36.0–47.0%
Calibration gap0.0 ptslower is better · 0.0% of answers at confidence 1.00
Automation at 95%—no probabilities
Speed—median · p95 —
Stability0.0%of answers change on an identical rerun
Valid output100.0%0.0% refused · 1,500 of 1,500 answered
Setupconstant probabilities · reasoning — · temperature — · 300 items × 5 runs
- Model id
- —
- Served as
- —
- Adapter
- —
- Host
- —
- Price as of
- —
- Harness
- —
- Release
- 2026-09-18