Cohere Releases 218B-Parameter MoE Translation Model Supporting 50 Languages
Cohere quietly published North Small Translate on September 9, 2026, a 218-billion-parameter Mixture-of-Experts model built exclusively for machine translation across 50 languages. Despite its massive total parameter count, only 25 billion parameters are active per token, allowing a 4-bit quantized version to run on a single NVIDIA B200 or two H100 GPUs. The model achieved a WMT26 score of 83.60, which can be improved to 84.36 using an agentic multi-pass refinement workflow. Weights are available on Hugging Face for research and non-commercial use under a CC BY-NC 4.0 license, while production deployments require a commercial license through Cohere's Model Vault. The low-key release, which appeared on Hugging Face weeks before any official announcement, signals a broader industry shift toward treating large specialized models as deployable industrial components rather than headline events.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in