SparkLLM Open-Sources Two On-Device AI Models With 1 Million Token Context

SparkLLM has released and open-sourced two on-device AI models, Spark X2.5-4B and Spark X2.5-1.7B, both supporting a native context window of up to one million tokens — a first for on-device models. The models were pre-trained on approximately 20 trillion tokens and refined using supervised fine-tuning and reinforcement learning on a domestic compute platform. They are designed for real-world tasks such as document analysis, coding, smart home control, and robotics, with the 1.7B variant achieving 90.3% command accuracy on a smart-home benchmark. Both models support multiple hardware platforms including NVIDIA and Huawei, and are compatible with popular deployment tools like Ollama, LM Studio, and llama.cpp. Weights, code, and documentation are now publicly available on GitHub and Hugging Face, with a larger 293B model announced for release on September 7.