SuperGLUE
2019-05-02 — 2021-01-06 · lived 1 year, 8 months
Saturated — everyone knew the answers
Built to leave headroom, because GLUE had just run out of it: the BERT baseline opened at 69.0 against a human score of 89.8, a gap its authors called substantial. It lasted twenty months. DeBERTa crossed the human line in January 2021, and the board has barely moved since.
How the frontier caught up
At launch, then at the date we bury it. The ceiling is what the number could not get past, and it is not the same measurement on every grave — it says which.
A benchmark gets no deprecation notice. This death date is our editorial judgment: we bury a benchmark when frontier scores stop telling top models apart, or when major labs stop reporting it. The sources below are the evidence — judge it yourself.