# Mistral Medium 3.5 (Mistral AI)

LLM, Mistral AI, no reasoning. Verbalized probabilities through the Jevals adapter, via OpenRouter · Mistral.

| Board | Decision Score (95% range) | Rank | Accuracy | Calibration gap (ECE, pts) | Hand-off at 95% | $ per 1k decisions | Speed p95 |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [noul (PubMedQA)](https://jevals.com/noul/) | 58.0 (45.3 to 69.8) | tied for rank 3 of 8 | 88.8% | 5.2 | 65% | $0.87 | 917 ms |
| [choice (Banking77)](https://jevals.com/choice/) | 59.5 (54.3 to 64.8) | rank 5 of 8 | 74.5% | 8.1 | 11% | $1.5 | 1.4 s |
| [score (HelpSteer2 helpfulness)](https://jevals.com/score/) | −13.7 (−28.3 to −0.1) | rank 5 of 8 | 43.9% | 33.6 | — | $1.3 | 1.2 s |

Decision Score: 100 = perfect, 0 = guessing the label base rates, below 0 = worse than that. Ranks: 1 + the number of rows significantly better (paired item bootstrap, 95%); rows that cannot be told apart share a rank. Hand-off at 95%: the share of decisions a model can take alone, at its own confidence threshold, while staying at least 95% right.

Setup: model id mistralai/mistral-medium-3-5; served as mistralai/mistral-medium-3-5; adapter jevals-llm 0383a0e3e592; reasoning none; temperature provider default; price as of 2026-09-18.

Compare: [Jev vs Mistral Medium 3.5](https://jevals.com/compare/jev-vs-mistral-medium-3.5/)

Source: https://jevals.com/models/mistral-medium-3.5/ · release 2026-09-18, suite 0.1.0 · data (CC-BY-4.0): https://jevals.com/data/releases/2026-09-18/board.json · cite as: Jevals (jevals.com), release 2026-09-18, suite 0.1.0. CC-BY-4.0.