OpenSquilla routes AI agent requests to cheapest capable model per turn
OpenSquilla is an open-source AI agent framework that uses a local classifier called SquillaRouter to dynamically select the least expensive model capable of handling each individual request. Unlike most agent frameworks that fix model choice at configuration time, OpenSquilla treats model selection as a live routing decision made before every turn. The system operates on a microkernel architecture, meaning routing, memory, web search, and tool dispatch all share a single unified loop regardless of whether input arrives via web UI, CLI, or chat platforms like Slack, Telegram, or Discord. SquillaRouter runs entirely on-device using ONNX Runtime and LightGBM, and supports over twenty LLM providers including OpenAI, Anthropic, Ollama, and Gemini. Currently at version 0.5.0 Preview 4, the project is still in preview stage and its core claim — that agent traffic can feed a self-improving routing model over time — remains an open question under active development.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in