VIDRAFT releases 180B-parameter AI model designed to run on consumer gaming laptops

·4 views

VIDRAFT has released POCKET-Darwin-180B, a large 180-billion-parameter AI model. It is engineered to run on consumer hardware like a gaming laptop with only 8GB of VRAM and 32GB of system RAM. The model achieves this through a combination of a sparse architecture, SSD streaming, and a portable runtime. Its primary purpose is to enable local, offline inference for sectors with strict data privacy rules, such as defense and healthcare, where cloud access is prohibited.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Full Stack Developer Outlines Plan for Transition to Cybersecurity Career

A full stack developer with six years of experience is planning a career shift from development to cybersecurity, citing concerns about burnout. Their initial strategy involves volunteering for existing security-related tasks within their current organization, such as application security fixes and compliance work. They note that application security is a natural entry point for developers due to their existing knowledge of code and systems. The developer is supplementing this practical experience by pursuing formal cybersecurity education and certifications. They believe hands-on security work will be more valuable than credentials alone when applying for future roles in the field.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

MikroTik RouterOS flaw allows TLS/SSH trust abuse, requires immediate patching

CERT Polska disclosed CVE-2026-67278, a vulnerability in MikroTik RouterOS 7.x, on September 5, 2026. The flaw is in RSA signature verification, allowing attackers to forge trusted certificates for TLS and weaken SSH authentication. An attacker could exploit this by redirecting a device's outbound connection to issue certificates for any domain without a private key. Affected versions are RouterOS 7.x from 7.0.0 before 7.23.6 and from 7.24 before 7.24.3. The issue is fully fixed in versions 7.23.6 and 7.24.3.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer logs Day 15 of learning core JavaScript concepts

A developer documented their progress on a 30-day learning challenge. They focused on essential JavaScript syntax and methods, including array manipulation with splice, map, and filter. Key concepts covered also included the spread and rest operators, arrow functions, and the fetch API for data requests. The learning session included understanding asynchronous programming with Promises and the evaluation of truthy and falsy values.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

New Techniques Enable Consumer GPUs to Run Massive AI Models Efficiently

Multiple distinct technical approaches now allow multi-billion parameter large language models to run on consumer-grade hardware. The Strata method manages memory for general Mixture of Experts models by caching experts across system memory tiers without modifying the model. A separate, specialized engine runs DeepSeek V4 Flash models by leveraging their built-in sparse architecture to drastically reduce memory use. Future inference engines are expected to unify these approaches with modular components for memory scheduling and KV compression. These developments will enable a single, versatile engine to efficiently support various large model architectures.

0 comments Read more at DEV Community