ggufit: A One-File CLI That Checks If a Local GGUF Model Fits Your GPU's VRAM

A developer grew frustrated with discovering out-of-memory failures only after downloading large local language models, so they built ggufit, a standard-library-only Python script. The tool reads a GGUF file's header to determine its real architecture and quantization, then estimates whether the model fits a chosen GPU. It accounts for KV cache at a given context length and compares requirements against usable VRAM after driver and OS reserves. Users can also check models before downloading by supplying parameter count and quantization manually, and the tool offers suggestions such as shorter context or partial CPU offload when a model won't fit. The project is MIT-licensed and hosted on GitHub.