Developer Builds 340MB Portable AI Agent That Runs From a USB Stick
A developer has created a self-contained AI agent package of just 340MB that can run on any x86_64 Linux machine without requiring system dependencies. The setup, called Norax, bundles a standalone Python environment, a CPU-only Ollama binary, and a memory database into a single directory. GPU libraries were stripped to keep the package lightweight, saving around 5GB of space, while relative paths ensure it works from any mount point. The AI model is downloaded on first run, and memory persists across sessions. The project demonstrates that a fully functional AI agent runtime with tools and an HTTP API can be made genuinely portable today.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in