/

← All benchmarks

Video-MME

multimodal · video-understanding↗ Quelle

87Evidence

active

What it measures

Videoverstaendnis ueber kurze bis sehr lange Clips, mit und ohne Untertitel.

What it does not measure

Standbilder, Audio allein.

How the score is composed

Currency91

Discrimination100

Headroom100

Contamination safety55

Gaming resistance100

Methodological rigor80

Reproducibility60

Details

Benchmaxxing risk: low
Difficulty: high
Public test set: yes
Human-verified: yes
LLM-judged: no
Letzter Messwert: 2026-10-11
Skala: 0–100 % correct (höher besser)

Best measured models

1Mage-VLMicrosoftvendor number59.7 % correct
2Phi-4-multimodalMicrosoftvendor number50.8 % correct
3Nemotron 3.5 Super VLNVIDIAvendor number32.85 % correct