Mia's AI Lab publishes open-source local LLM recipes for NVIDIA GPUs on GitHub

Mia's AI Lab, a project maintained by a solo developer named Mia, offers free open-source setup recipes designed to help users run large language models locally on NVIDIA RTX GPUs and DGX Spark hardware. The platform addresses common barriers such as choosing the right quantization level, estimating VRAM requirements, and selecting inference engines like vLLM or SGLang. As of September 26, 2026, the project hosts 16 model recipes plus a tool called sparkDash, collectively accumulating over 5,000 GitHub stars. Each recipe bundles scripts that automatically detect available VRAM, select an appropriate quantization level, download model weights, and launch an OpenAI-compatible API endpoint on both Windows and Linux. The site also publishes benchmark data including decode speed, peak throughput, and context window size, giving prospective local-AI builders a practical reference for hardware planning.