GLUE
2018-04-20 — 2019-07-12 · lived 1 year, 2 months
Superseded — a harder one replaced it
Nine tasks collapsed into one number, and the number was 70.0 the day it opened — low enough that its own authors called that a problem. Fifteen months later the frontier was 88.4, past the human baseline of 87.1, and those same authors published SuperGLUE because nothing was left here to measure.
How the frontier caught up
At launch, then at the date we bury it. The ceiling is what the number could not get past, and it is not the same measurement on every grave — it says which.
Replaced by SuperGLUE, which is also buried here.
A benchmark gets no deprecation notice. This death date is our editorial judgment: we bury a benchmark when frontier scores stop telling top models apart, or when major labs stop reporting it. The sources below are the evidence — judge it yourself.