Last refresh: 2026-05-17 · 17 models graded 3 OPEN RUBRIC ITEMS · DeepSeek judge coverage: 98%

← Leaderboard

OpenAI GPT 5.4 (non-thinking)

Weighted composite
3.50
Recommendation
Practitioner-grade
Cohort
legacy frontier

Scorecard

Per-criterion scores not available for this model. It appears in the cross-part overview but is not part of the canonical Models 1–10 hand-graded set; only the headline composite is shown.

Per-part composites

PartOpus 4.7 (inline)DeepSeek V4 Pro (judge)
Part A 3.50rep-sample → 3.65 full-pass⁴ 2.30
Part B 3.20sampled (`_or`)¹ 2.30
Part C 4.00(`_or`)² 4.35

Notes from the evaluation

OpenAI GPT 5.4 (non-thinking) r1 — composite 3.65

Source files in the repo

Cross-judge composites: analysis/results_overview.md

Full report · PDF

Get the full report

All 111 questions, the complete rubric, per-model verdicts, and the methodology paper. Delivered as PDF within 60 seconds. CC-BY 4.0.

Sent from noreply@verdatir.com. We store your address to deliver the report and, if you opt in, future updates. See /privacy. CC-BY 4.0.
Welcome back. You've already requested the full report.

Download the report (PDF) ↓