Nemotron 3.5 Transcribe runs on one 32 GB Blackwell GPU, with output set by the prompt

NVIDIA released Nemotron 3.5 Transcribe on 28 October under the OpenMDW-1.1 license, with an open serving recipe built on vLLM and the NeMo Speech plugin. A tester ran the smallest 21.6 GB NVFP4 version on a single 32 GB RTX PRO 4500 Blackwell card and wrapped it in a custom backend that serves the standard OpenAI transcription route. The prompt controls the output style: verbatim, clean, or speaker-labelled with word-level timings, though the clean style still left speaker tags and a false start in the text. On short English clips the model's word error rate was 6.82%, roughly between two comparison systems, but it varied widely, performing best on audiobook speech and weakest on crosstalk-heavy office meetings. The tester urged users to test their own recordings, noting the sample was small and that throughput was not measured.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in