B-Draft trains language model from scratch using inference-only NPU chips

South Korean company B-Draft has successfully pre-trained a small language model from scratch using only inference-dedicated NPU chips, a feat previously considered structurally impossible. The resulting model, named VKORE-46M-NPU, has been released publicly on Hugging Face. The training, conducted on 32 first-generation chips, produced a loss trajectory with a 0.99 correlation coefficient to an identical model trained on a GPU under the same conditions. This breakthrough suggests NPUs could be used for affordable, on-premises AI training, reducing dependency on expensive, high-power GPU servers.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in