/

← All benchmarks

MGSM

multilingual · math-transfer↗ Quelle

44Evidence

active

What it measures

Grundschulmathematik in elf Sprachen — misst Sprachtransfer, nicht Mathematik.

What it does not measure

Sprachqualitaet, Idiomatik.

How the score is composed

Currency95

Discrimination26

Headroom52

Contamination safety15

Gaming resistance55

Methodological rigor50

Reproducibility60

Details

Benchmaxxing risk: medium
Difficulty: low
Public test set: yes
Human-verified: no
LLM-judged: no
Letzter Messwert: 2026-09-10
Skala: 0–100 % correct (höher besser)

Best measured models

1DeepSeek V4.1 FlashDeepSeekvendor number84.4 % correct
2DeepSeek V4 ProDeepSeekvendor number81.3 % correct