Engineer Converts $60 Xiaomi Phone into Always-On Edge AI and Storage Server

A developer repurposed an old Xiaomi Redmi 9I smartphone into a 24/7 edge AI node and local storage server drawing just 1.2W at idle and 4.2W at peak load. The setup runs a Linux chroot on rooted Android, hosting Whisper.cpp for speech-to-text and a quantized Qwen 2.5 language model via llama.cpp, alongside an S3-compatible blob store and SQLite database. The phone's built-in 5,000mAh battery serves as a zero-cost UPS, keeping the node online during the roughly daily power outages the developer experiences. A custom supervisor watchdog automatically flushes dead connections and resyncs Cloudflare tunnels when Wi-Fi returns after an outage, eliminating the need for manual intervention. The system delivers around 7 tokens per second for LLM inference, sub-millisecond local storage responses, and maintains stable thermals of 32–34°C without active cooling.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in