POCKET-27B-Pi: 27B coding agent packed into a 16.5 GB file for a single 24 GB GPU

VIDRAFT has released POCKET-27B-Pi, a coding agent distributed as a single 16.5 GB GGUF file in Q4_K_M quantization. On the partner's own Terminal-Bench 2.1 run under the pi agent, it solved 28 of 48 tasks (58.3%), compared with 19 of 48 (39.6%) for the base Qwen3.8-27B model. The model keeps key-value cache in only 16 of its 64 layers, so a 64K-token context needs about 4.0 GiB in f16 and less when quantized. By the article's arithmetic, weights plus a 64K cache total roughly 19.5 GiB, which fits on one 24 GB GPU. The benchmark figures are VIDRAFT's own measurements, and the memory calculations were made by the article's author, who is affiliated with the partner.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in