Smart Routing cuts LLM costs vs premium models but trails cheaper fixed options

·23 views

LLM Gateway published a benchmark testing its Smart Routing system against three fixed-model baselines across 80 standardised prompts covering arithmetic, reasoning, and instruction-following tasks. Smart Routing cost 33.2% less than the fixed premium baseline but was 35.6 times more expensive than the fixed low-cost option. On task success, Smart Routing scored 75 out of 80, comparable to the low-cost baseline at 74 and the mid-priced at 76, while the premium model also scored 74 under strict grading. The cost savings against the premium baseline carried wide statistical uncertainty, with the confidence interval ranging from a 4.3% increase to a 66.1% decrease, meaning no reliable reduction was established. The benchmark was authored by an LLM Gateway employee and prepared with AI assistance, which the publication disclosed upfront.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

UIDAI Unveils Lighter Sub-AUA/Sub-KUA Route for Low-Volume Aadhaar Users

On 29 September 2026, UIDAI announced five initiatives at Aadhaar Samvaad in Kolkata, including a new LITE framework for Sub-AUAs and Sub-KUAs. Sub-AUAs and Sub-KUAs access Aadhaar services through an existing AUA or KUA, which handles Yes/No authentication and e-KYC respectively. The LITE framework is intended to simplify and speed up onboarding for entities with lower authentication volumes, including government and eligible non-government bodies. Under existing rules, AUAs and KUAs need UIDAI approval before appointing a Sub-AUA or Sub-KUA, and they remain jointly liable for compliance. The article notes that UIDAI has not yet released full details of the LITE route, so regulated entities such as lenders and fintechs are advised to prepare while awaiting clarification.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Money Tracker app explains bill import without bank logins, using confirm-before-save

The developer of Money Tracker, an expense app for Android and iOS, describes its statement and bill import feature, which is available on the Premium tier. Users export a file such as a PDF or CSV from their bank or card issuer, then upload it to the app, which parses it into draft entries. Each draft must be reviewed and confirmed by the user before it is saved to their records. The developer stresses that the app never asks for bank credentials and does not maintain ongoing connections to accounts, unlike bank-sync services. The post presents this as a narrower, more controlled alternative to automatic open-banking sync.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Contact form shows success but enquiries go missing: how to trace one test message

A contact form can display a success message while the enquiry never reaches the team's mailbox. The recommended approach is to follow a single identifiable test submission through the form, the sending route, and the receiving mailbox, rather than changing the mail plugin or DNS first. A successful wp_mail() return only means the sending method processed the request without error, not that the recipient got the email. Form plugins may also have demo or skip-mail settings that show success without sending, so these should be checked. Each finding, such as no matching record, a sending error, or provider acceptance, points to a different next check.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Handling Email API Timeouts in Order Report Delivery

An email API timeout should be treated as an unknown delivery state rather than a confirmed failure, since the server may have accepted the message even though no response arrived. The article recommends recording an idempotency key before the first send attempt and separating connection, request, and delivery deadlines to pinpoint where delays occur. Attachment generation should move out of the synchronous request path, with the web request only enqueuing a durable job that a worker processes. Retries are only safe when the receiver supports idempotency or the outcome can be reconciled, otherwise duplicate emails may be sent. Deadlines should be chosen per workflow phase and kept in configuration.

0 comments Read more at DEV Community