# MMLU

> Fifty-seven subjects, from elementary mathematics to professional law, and in 2020 the best GPT-3 managed 43.9 — nineteen points over guessing. By January 2025 OpenAI's o1 sat at 91.8, and errors in 6.49% of questions put the ceiling near 93.5. Anthropic's next flagship printed no MMLU score.

2020-09-07 — 2025-02-24

This URL is the guided walk — the 3D cemetery, standing at this grave. The written record is at [MMLU's epitaph](https://models.rip/mmlu/epitaph).

## Elsewhere

- [The whole cemetery](https://models.rip/)
- [The dataset](https://models.rip/graveyard.json)