Goku: Browser-Based LLM Inference Tool Powered by WebAssembly
A developer has released Goku, an open-source tool that runs large language model inference directly in the browser using WebAssembly technology. The project leverages wllama, a WebAssembly-based LLM runtime, to enable on-device AI inference without requiring a server backend. Goku also includes a model manager, allowing users to handle and switch between different language models within the browser environment. The project was shared on Hacker News by its creator, with the live demo hosted on GitHub Pages.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in