ModelRadar
/
← All benchmarks

SWE-Lancer

coding · economic-value↗ Quelle
67Evidence
not yet measured

What it measures

Echte bezahlte Freelance-Aufgaben; bewertet wird in Dollar geloester Auftragswert.

What it does not measure

Grundlagenwissen, Geschwindigkeit.

How the score is composed

Currency50
Discrimination50
Headroom50
Contamination safety100
Gaming resistance100
Methodological rigor80
Reproducibility20

Details

Benchmaxxing risk
low
Difficulty
high
Public test set
no
Human-verified
yes
LLM-judged
no
Skala
0–1000000 USD solved (höher besser)

Hand-maintained — no automatic adapter yet.

Best measured models

No results ingested yet.