Nemotron 3.5 Transcribe: How to Run NVIDIA's Open ASR Model Locally on One GPU

NVIDIA's Nemotron 3.5 Transcribe can be run on a single GPU to transcribe hour-long recordings in 40 languages without per-minute API fees or sending audio to third parties. The model is the leading open-weights system on the Hugging Face Open ASR Leaderboard and is released under the commercially friendly OpenMDW-1.1 license. Weights in BF16, FP8 and NVFP4 formats were published on October 28, 2026, with NVIDIA's reference target being an H100 80 GB GPU. The guide covers hardware compatibility, three runtime options (vLLM, SGLang-Omni and Transformers), and setup commands taken from the official model card. Users without suitable hardware can alternatively use a hosted API priced at about US$0.002 per minute.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in