Llama 3.1 405B Instruct

Four hundred and five billion parameters that anyone could download, which Meta called the first frontier-level open source model and almost nobody had the hardware to serve. Its more consequential job was as a teacher: the licence was rewritten so that its outputs could legally train other models, and a great deal of what it knew now lives inside models small enough to run on one card.