# Mixtral 8x7B

> A sparse mixture of experts that held its own against far larger models while using only a fraction of its parameters on any given token, and that arrived as a torrent link before anyone had written it up. Mistral's endpoint for it closed; the weights did not. It is the one grave here with something still living in it.

2023-12-11 — 2025-03-30 · lived 1 year, 3 months

This URL is the guided walk — the 3D cemetery, standing at this grave. The written record is at [Mixtral 8x7B's epitaph](https://models.rip/open-mixtral-8x7b/epitaph).

## Elsewhere

- [The whole cemetery](https://models.rip/)
- [The dataset](https://models.rip/graveyard.json)