SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

Open-source gputaskman tool links GPU process data with local AI model evidence

0
·2 views

Scott Hanselman's open-source gputaskman project is a terminal tool that shows what is using a computer's graphics hardware. It combines per-process GPU memory and engine activity with evidence about loaded runtimes, model files, and local AI workloads. The project treats device and process counters as measurements, while classifications and GGUF-derived model breakdowns are presented as estimates. Because a loaded runtime or mapped file does not prove a model is resident on the GPU or actively running, the distinction matters for users. The MIT-licensed tool supports Windows, Linux, and WSL, with macOS support for Apple Silicon, though available readings depend on the operating system, GPU, and driver, and the project calls itself experimental.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Ask HN thread invites readers to share current projects and curiosities (November 2026)

A Hacker News 'Ask HN' thread from November 2026 asks community members what they are currently building and what topics have recently caught their interest. The post has drawn 12 points and 8 comments at the time of reporting. It is a community discussion prompt rather than a news event, so no specific projects or announcements are reported in the source material. Readers can follow the linked thread to view individual responses.

0 comments Read more at Hacker News
0
ProgrammingDEV Community ·

Agent-Written Endpoint Triggers N+1 Queries; Query-Count Test Catches It Early

A developer describes an AI coding agent's GET /orders handler that returned correct data but issued one database query per order, 101 queries for a 100-row page. Existing functional tests passed because they only checked the response body, not the query count. The author shows how the N+1 pattern arises in node-postgres and Express code, even though each line looks correct. To catch it, the author proposes a test helper that wraps the pool's query method to record each SQL statement while still executing it. Running this counter within a test lets a branch fail before the regression is merged.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Running Qwen3.8-Flash-Next Locally Depends on Total Memory, Not Active Parameters

Qwen3.8-Flash-Next activates only 6B parameters per token, but its GGUF files range from about 66 GB for the smallest 1-bit quant to 111 GB for the common UD-Q4_K_XL. The article argues that total memory, not the card's active parameter count, determines whether the model can run locally. A community llama.cpp benchmark reported 39 tok/s for UD-IQ4_XS with experts held in 96 GB of system RAM and a simulated 24 GB VRAM budget. The n-gram embedding table, about 27 GiB in one quant, can sit in system RAM or be paged from SSD because each token reads only a few rows. Qwen's release is an experimental preview under the qwen-community-1.0 license, which is not Apache 2.0.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Vietnam and South Korea to Hold AI and Semiconductor Conference in Hanoi on November 12-13

Vietnam's Ministry of Science and Technology has announced the First Vietnam-Korea AI and Semiconductor Conference, scheduled for November 12-13, 2026 in Hanoi. The summit is expected to draw more than 400 delegates, 50 semiconductor and AI companies, research institutes, and universities from both countries. Organizers include the ministry's Department of Digital Technology and AI, FPT Corporation, the Korea AI-Semiconductor Fabless Alliance, and VINASA's semiconductor committee. Discussions will focus on aligning bilateral policy, integrating semiconductor supply chains, and building workforce programs tied to Vietnam's national semiconductor strategy and its initiative to train 50,000 semiconductor and AI engineers.

0 comments Read more at DEV Community