ML//model//open source model//Mistral
- French startup, tiny team, punching way above weight class.
French startup, tiny team, punching way above weight class.
Mistral 7B matched LLaMA 2 13B. Mixtral introduced mixture-of-experts to open models.
Proof that architecture innovation + good data can beat raw scale.