Developer builds Mac runtime for NVIDIA's multimodal Nemotron-30B after official tools fell short

NVIDIA released Nemotron-3-Nano-Omni-30B-A3B, a 30-billion-parameter open-weight model capable of processing text, images, and audio, but its vision and audio components lacked support for Apple Silicon. A community member had already converted the model to a 4-bit MLX format compatible with Mac hardware, yet no open runtime existed to activate the multimodal features. A developer identified this gap and spent roughly half an hour writing the missing inference code by running parallel agents on each tower simultaneously. The resulting implementation allows the full tri-modal model — vision, audio, and language — to run locally on a Mac laptop in about 35 seconds with no data sent externally. NVIDIA's referenced engine, Evorix, was cited in the model card but could not be found publicly, making the community-built workaround the only known open option for Mac users.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in