#benchmarks
2 total
Deep Research
5 minHumanity's Last Exam Explained: Where 2,500 Frontier Questions Come From and How to Read the Scores
HLE is the most-cited frontier reasoning benchmark: 2,500 cross-disciplinary questions finalized 2025-04-03 after bounty cleanup, published in Nature 2026-01-28, with a dynamic HLE-Rolling variant. Origins, dual scoring, citation rules.
Read articleDeep Research
7 minHow to Read the Benchmark Charts in a Model Launch: Effort Curves, Log Cost Axes, and Safeguard Interventions
Model-launch accuracy-vs-cost charts carry hidden methodology choices. Worked on the 2026-09-01 Claude Fable 5.1 announcement: effort curves, log axes, error bars, scoring conventions, missing cells, safeguard zero-scores.
Read article