Moonshot AI Releases Kimi K3 Open Weights: A 1.56 TB Sparse MoE Model on Hugging Face
Moonshot AI last week published the Kimi K3 model weights on Hugging Face, making available a 2.8-trillion-parameter sparse mixture-of-experts model compressed in MXFP4 format. The full checkpoint spans roughly 1.56 TB across 96 safetensors shards, accompanied by configuration, tokenizer, and evaluation metadata files. Serving the model requires compatible software such as vLLM or SGLang, with support varying depending on the user's GPU generation. The model is released under a custom, non-OSI license that permits commercial use but imposes revenue-tier conditions and lists prohibited use cases. Developers are advised to pin a specific repository revision before downloading to avoid inconsistencies if the upstream files are updated.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in