SShortSingh.
Back to feed

Why Your 8GB VRAM GPU Shows 24GB in Windows — And What Actually Fits

0
·1 views

A developer testing an RTX 5060 laptop found that Windows reports 24GB of display memory, but only 7.9GB is dedicated VRAM, with the rest being slower shared system RAM. The two memory pools behave very differently under load, making the advertised figure misleading for anyone trying to run AI models locally. Benchmarks on the same machine showed that dense models must be around 7GB or smaller at 4-bit quantisation to run reliably, while mixture-of-experts models can be larger if experts are streamed from system RAM. A model that had been running successfully for over a week suddenly failed to load, traced not to a bug but to a silently recreated local alias that altered memory calculations. The findings highlight that model architecture matters more than parameter count, and that available VRAM at runtime is narrower than any spec sheet suggests.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Developer Builds AI Insurance Claim Analyzer Using RocketRide Pipeline

A developer created ClaimDesk, an AI-assisted insurance claim intake and analysis application built on the RocketRide framework. The tool allows claims adjusters to upload vehicle damage photos and accident descriptions for automated analysis. Ollama was integrated for local model execution, with a unified startup workflow managing all dependencies and services. Building ClaimDesk reinforced that AI applications demand the same engineering rigor as traditional software, including architecture planning, debugging, and reproducible environments. The project offered the developer practical insight into integrating agentic AI into real-world software rather than using it as a standalone model.

0
ProgrammingDEV Community ·

Epic, GOG, and NVIDIA all confirm native Linux clients are in development

Three major gaming companies signaled a shift toward native Linux support in August 2026. An Epic Games developer confirmed in a Discord AMA that a native Linux version of the Epic Games Store launcher is coming, though not for the platform's upcoming preview release. GOG separately confirmed to GamingOnLinux that a native Linux version of GOG Galaxy is in progress, with no timeline provided. NVIDIA's GeForce NOW app for Linux officially exited beta, adding support for Ubuntu 24.04 and a Flatpak repository for easier installation. Analysts point to Linux surpassing 4% on the Steam Survey since mid-2025 and the success of Valve's Steam Deck as key factors pushing companies to prioritize the platform.

0
ProgrammingHacker News ·

Developer builds 3D desktop fruit fly for macOS using real neural connectome data

A developer has created a macOS desktop application featuring an animated 3D fruit fly powered by the FlyWire connectome, a detailed map of the fly's neural connections. The project is open source and hosted on GitHub under the username DenisSergeevitch. FlyWire is a scientific initiative that has mapped the complete connectome of a Drosophila fruit fly's brain. The application brings real neuroscience data into a visual, interactive desktop experience on Apple's macOS platform. The project was shared on Hacker News, where it received modest early attention.

Why Your 8GB VRAM GPU Shows 24GB in Windows — And What Actually Fits · ShortSingh