China's Kimi K3 debuts with 2.8 trillion parameters and 1 million token context window
Moonshot AI has released Kimi K3, a 2.8 trillion parameter foundation model designed to push the limits of AI performance. The model features a one million token context window, native multimodal support for text, images, and documents, and built-in long-term agent capabilities. Kimi K3 uses a proprietary KDA hybrid linear attention mechanism that replaces traditional quadratic-scaling attention, making large-context processing more computationally efficient. On key benchmarks, the model ranks at the top tier in software engineering and web browsing tasks, including a 91.2 score on BrowseComp and 88.3 on TerminalBench. The model is accessible via Moonshot AI's API and supports complex multi-step workflows suited for enterprise and engineering use cases.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in