Laya AI Decision API Promises Sub-35ms Classification Without Large Language Models

A developer has launched Laya, a free AI decision-making API designed to replace large generative models like GPT-4o for simple classification tasks such as spam filtering, sentiment analysis, and prompt injection detection. Unlike token-by-token generative models that can take 1,500ms to 3,500ms to respond, Laya uses a 322-million-parameter multilingual bidirectional encoder to compute results in a single forward pass, targeting under 35 milliseconds at the model level. The tool offers six dedicated endpoints covering support ticket triage, content moderation, spam filtering, and a universal decision engine, among others. Laya is available via the RapidAPI marketplace, though real-world latency through that gateway ranges from 750ms to 1,200ms due to proxy routing and authentication overhead. The service claims a privacy-first design, processing all payloads in ephemeral RAM with no logging or storage of user data.