Inkling-2-Mini Model Reported to Run in 5.4 GB of Memory
A GitHub project titled 'lookatmyquant' has been shared on Hacker News, linked to a model called Inkling-2-Mini. The post's headline claims the model fits within 5.4 GB of memory. The shared material is a repository link, and the available source text provides little detail beyond it. The Hacker News entry had 3 points and no comments at the time it was captured. Further technical specifics about the model and its quantization approach are not included in the source.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in