Developer Launches Free AI Model Tracker Covering 900 Models and 2,300 Static Pages

·1 views

A systems engineer has publicly launched theknowngood.com, a website that aggregates evaluation data for around 900 AI models, including benchmark results, pricing, arena ratings, and performance metrics. The site is built as fully static HTML rendered via Python and Jinja2 from a Postgres database, meaning no database queries occur at request time. All CSV and JSON data exports are freely available under a CC BY 4.0 license, with no user accounts, tracking, or inbound API. For security, nginx is bound to loopback only and the site is served through an outbound tunnel, eliminating public-facing open ports entirely. The project is currently self-hosted on home hardware, and the creator is actively seeking user feedback on performance and test coverage gaps.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Zero-Copy Multi-Protocol Storage Can Eliminate Sync Jobs in Cloud Data Pipelines

Most cloud migration architectures rely on sync jobs that duplicate data from legacy file shares into S3, creating two copies that must be kept consistent and introducing latency, extra cost, and potential data drift. A zero-copy, multi-protocol storage pattern eliminates this redundancy by allowing the same underlying data volume to be accessed simultaneously via SMB, NFS, and S3 without replication or translation. Amazon FSx for NetApp ONTAP enables this approach natively, letting legacy applications continue writing over network file protocols while cloud-native services read the same bytes through an S3 Access Point. A proof-of-concept built on this architecture transformed an insurance claims intake pipeline, reducing processing reaction time from scheduled batch intervals to near-instant response. Beyond cost savings from eliminating duplicate storage, the pattern fundamentally changes real-time capabilities for legacy systems by making files visible to cloud compute the moment they are written, rather than after a sync cycle completes.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

LLM Cost Routing Cuts Inference Spend 48x and Fixes Broken Margin Curves

A software team discovered that one frontier AI model was handling 77% of their calls and consuming 97% of their inference budget simply because it was the default setting, not because most tasks required it. After measuring a week of production traffic, they found their average call cost $0.00524 on the frontier model versus $0.00011 on a capable open-weight alternative — a roughly 48x difference. Under a $20/month subscription plan, routing all calls through the frontier model turned high-engagement users into a financial loss, while task-based routing kept margins above 97% even at 5,000 messages per month. The key insight is that smart routing does not merely reduce average costs — it reverses the marginal cost curve so that heavier product usage compounds profit rather than loss. The team cautioned, however, that a cheaper model requiring multiple retries can quickly erase those savings, making reliable routing logic essential.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Managed vs Self-Hosted React Native OTA: It's About Ownership, Not Infrastructure

When choosing between managed and self-hosted Over-the-Air (OTA) update systems for React Native apps, the core difference lies in who owns operational responsibility, not where files are stored. Both approaches support channels, rollouts, rollbacks, and CDN delivery, but a managed service shifts platform operations to a provider while self-hosting places that burden on the organization. One responsibility that cannot be outsourced in either model is verifying that an OTA update is compatible with the native binary already installed on a user's device, since OTA can only replace JavaScript and bundled assets, not native modules or compiled capabilities. Self-hosted systems offer greater flexibility and control but require the organization to handle server upgrades, security patching, backups, and multi-generation client protocol compatibility. The right choice depends on an organization's size, regulatory requirements, and existing platform capabilities rather than a universal preference for one model over the other.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Most Google Trends Are Already Over by the Time You See Them

A developer analysis of Google's Trending Now feed reveals that the majority of trending topics have already stopped trending by the time most tools or pipelines process them. Using four data fields — started_at, ended_at, is_active, and duration_minutes — it is possible to track the full lifecycle of a trend rather than just its rank. In a 24-hour snapshot of the US feed, 298 of 421 trending terms had already ended, with a median lifetime of roughly two hours. A 48-hour UK feed pull showed 530 of 615 terms had expired by the time of the pull, meaning pipelines that check once daily are reacting to largely stale data. The author recommends filtering on active status and sorting by duration as simple, low-cost improvements for any trend-driven workflow.

0 comments Read more at DEV Community