Moonshotai Releases Kimi-K3, a 2.8T Open-Weight Multimodal AI Model

·1 views

Chinese AI firm Moonshotai has released Kimi-K3, a 2.8 trillion parameter open-weight multimodal model, described as the world's first openly available 3T-class AI model. The model supports text, image, and video inputs within a single forward pass and offers a 1-million-token context window, making it suited for long-horizon coding, research, and document analysis tasks. It is built on proprietary Kimi Delta Attention and Attention Residuals architectures, using a Stable LatentMoE framework that activates only 16 of 896 experts per token for greater efficiency. Kimi-K3 is available on Hugging Face under the Kimi K3 License, which permits research and deployment use with certain constraints. Benchmark results show competitive performance against closed-source frontier models across software engineering, visual reasoning, and legal and financial document tasks.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Developer writes custom Linux driver to get free over-the-air TV on Raspberry Pi

A developer built a custom Linux kernel driver from scratch in May 2026 to make a MyGica A681 USB TV tuner work on a Raspberry Pi 5, after finding no compatible driver existed for the device. The tuner's manufacturer only provided a prebuilt driver for standard PC processors, leaving the hardware unusable on the Pi's different chip architecture. The developer leveraged existing open-source Linux TV community code for the tuning and decoding components, writing only the missing USB translator layer himself. An early debugging session revealed that a self-imposed configuration change — not a code flaw — was blocking video output, and restoring the original default immediately resolved the issue. The project ultimately enabled free, subscription-free over-the-air HD television on a kitchen-mounted smart home display.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AI Vendor Lock-In Can Cost Companies Over $3 Million When Switching Platforms

Migrating an AI production pipeline from a proprietary platform to an open-source stack carries far greater costs than the visible API bills suggest. A four-person senior ML engineering team may spend three to six months on migration tasks alone, including data reformatting, code refactoring, and output validation, amounting to roughly $200,000 in direct labor. If a fine-tuned model was managed by the vendor, companies must also retrain from scratch, with compute costs for a 7-billion-parameter model potentially reaching over $34,000 across multiple training runs. During the cutover period, businesses may face a 35% rise in inference latency and a 15% accuracy drop, which in high-volume systems can translate to an estimated $500,000 in lost value. Together, these financial, operational, and strategic costs illustrate why AI platform dependency poses a significant long-term risk for engineering organizations.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

10th Grader Builds Integer-Only Neural Net in Rust, Solves Quantization Dead Zone

A high school student developed Green-AI, a Rust-based project exploring energy-efficient AI training using only integer arithmetic instead of floating-point operations. During development, they discovered a 'dead zone' problem where weight updates silently stalled once errors became too small, rounding down to zero under a fixed bitshift operation. To fix this, they devised Adaptive Bitshift Learning (ABSL), which dynamically adjusts the shift amount based on error magnitude — amplifying small updates and damping large ones. Benchmarks comparing ABSL against a fixed-shift approach and stochastic rounding showed ABSL achieved the highest accuracy and faster per-step performance than stochastic rounding. The project's source code has been published on GitHub, and the student is seeking feedback from those experienced in quantized or fixed-point neural network training.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Why Developers Need Analog Breaks to Avoid Cognitive Burnout

Software engineers and tech workers spend up to 12 hours a day in high-intensity logical thinking, which the article argues leads to a state called 'cognitive memory fragmentation' — a mental slowdown analogous to a defragmented hard drive. The piece contends that constant context-switching, unresolved micro-tasks, and suppressed emotions clog working memory, reducing creativity and straining relationships. The author argues that passive digital detox, such as scrolling through a phone, is insufficient because it still engages background mental processes. Instead, the article advocates for deliberate 'analog breaks' — tactile, screen-free activities that allow the brain's Default Mode Network to reset and recover. Practical suggestions include journaling on paper, spending time in nature, and establishing screen-free spaces at home to build a more sustainable work-life balance.

0 comments Read more at DEV Community