Mistral Large 4 Weights Due Oct 31; Local Use Would Need Roughly 400GB of Memory
Mistral has announced Large 4, a 1.05 trillion parameter mixture-of-experts model with 52 billion active parameters, which it describes as open-weight. As of October 22 the weights are not yet downloadable, and the Hugging Face page points to an October 31 release. Mistral's documentation leaves the license unnamed, unlike its other recent models, which are listed under Apache 2.0. Self-reported benchmarks show mixed results, and commenters have questioned performance and pricing relative to rival models. Running the model locally would require memory for all of its parameters, with quantized estimates falling in the range of about 400GB or more.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in