40Evidence
not yet measuredWhat it measures
MBPP mit deutlich strengeren Testfaellen — deckt Scheinlosungen auf.
What it does not measure
Projektarbeit, Bibliotheksnutzung.
How the score is composed
Currency50
Discrimination50
Headroom50
Contamination safety9
Gaming resistance55
Methodological rigor50
Reproducibility60
Details
- Benchmaxxing risk
- medium
- Difficulty
- low
- Public test set
- yes
- Human-verified
- no
- LLM-judged
- no
- Skala
- 0–100 % pass@1 (höher besser)
Best measured models
No results ingested yet.