How FreeToolHub runs 21 AI tools entirely in the browser with no backend
FreeToolHub has built and shipped 21 AI-powered tools — including email writers, resume rewriters, image upscalers, and audio transcription — without any server, API keys, or upload endpoints. All models download directly to the user's browser and run locally, meaning user data never leaves the device, a deliberate privacy-first product decision. The team uses Hugging Face's transformers.js on top of onnxruntime-web, with WebGPU as the primary backend and WASM as a fallback, and maintains a single TypeScript registry as the source of truth for all 18 models. A key technical challenge was enabling SharedArrayBuffer for threaded models without breaking third-party ad and analytics scripts, which was resolved by using the lesser-known Cross-Origin-Embedder-Policy: credentialless header instead of the standard require-corp approach. To manage large model sizes — some exceeding 1 GB — the team ships two quantizations per model, caches downloads in IndexedDB, and offers a smaller 200 MB sibling model for users on slower connections.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in