# Mixtral 8x7B

> A sparse mixture of experts that held its own against far larger models while using only a fraction of its parameters on any given token, and that arrived as a torrent link before anyone had written it up. Mistral's endpoint for it closed; the weights did not. It is the one grave here with something still living in it.

2023-12-11 — 2025-03-30 · lived 1 year, 3 months

## The record

- Provider: Mistral AI
- Model id: `open-mixtral-8x7b`
- Cause of death: Superseded
- Notice given: 2024-11-30

## Sources

- https://docs.mistral.ai/getting-started/models/models_overview/
- https://mistral.ai/news/mixtral-of-experts
- https://venturebeat.com/business/mistral-ai-bucks-release-trend-by-dropping-torrent-link-to-new-open-source-llm/

## Elsewhere

- [Stand at this grave](https://models.rip/open-mixtral-8x7b)
- [The Mistral AI plot](https://models.rip/mistral-ai)
- [The whole cemetery](https://models.rip/)