/

← All benchmarks

MATH-500

math · school-competition↗ Quelle

55Evidence

saturated

What it measures

500 Aufgaben aus dem MATH-Datensatz, mittlere Schwierigkeit.

What it does not measure

Forschungsnahe Mathematik.

How the score is composed

Currency91

Discrimination100

Headroom11

Contamination safety15

Gaming resistance55

Methodological rigor50

Reproducibility60

Details

Benchmaxxing risk: medium
Difficulty: medium
Public test set: yes
Human-verified: no
LLM-judged: no
Letzter Messwert: 2026-10-13
Skala: 0–100 % correct (höher besser)

Best measured models

1LongCat-Flash-Lite-SparseMeituan LongCatvendor number96.8 % correct
2Apriel-VoiceServiceNowvendor number92.76 % correct
3ALoDLMAmazonvendor number61.8 % correct