SShortSingh.
Back to feed

Your AI System Is More Than the Model: What Production AI Architecture Actually Looks Like

0
·1 views

A production AI system is rarely just: That architecture works well in a demo. SotaTek, we approach AI development from this broader systems perspective: the model is only one layer of the product, while data, application logic, integrations, security, evaluation, infrastructure, and observability determine whether that capability can actually work in production. The interesting engineering problems are usually somewhere between those boxes. A better starting point is: Consider an internal support assistant. But the real requirement may be: The model is only responsible for part of that workfl

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

PHP PDF generation becomes slow when creating large documents

I am working on a PHP-based worksheet generation system and recently ran into a performance problem. The application generates printable PDF files based on user-selected options. The workflow is: User selects options ↓ Server generates data ↓ PHP creates PDF ↓ User downloads the file The problem is that the generation time increases significantly when the document contains many items. For example: 100+ exercises multiple pages answer pages custom layouts Current implementation The frontend sends a POST request to the PDF generation endpoint: $result = http_post( https://www.wativate.com/?api/p

0
ProgrammingDEV Community ·

I built a live map of natural events with Vue 3 and OpenLayers. Here are the mistakes I made.

Hi everyone 👋 I'm Andrea, a full-stack developer from Italy, living in Tenerife. Yes, that one, the island with the big Teide, a volcano, which is maybe why I ended up building this. I have been building Vue apps in production for about four years: a blockchain explorer, a marketplace, editors, dashboards, data visualisation pages. What I had never built is a map. No GIS, no projections, no OpenLayers.

0
ProgrammingDEV Community ·

🌱 Last Frost: A Garden Planner That Only Works If You Go Outside

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass Last Frost is an offline garden planner. You type your ZIP code and what you want to grow; it looks up your local first fall frost and last spring frost dates, then a small open-weight model running on your own machine tells you what to plant this week, what to hold back, and why — based on the actual number of frost-free days you have left. It's for anyone whose gardening app experience is: open app → get generic advice → still not know if it's too late to plant tomatoes. Last Frost replaces "generic" with

0
ProgrammingDEV Community ·

Jev-LCT: Free Calibrated Confidence from Looped Transformer Trajectories

Small decision models have two bad options today: generate text token-by-token (slow, fragile to parse), or "introspect" their confidence verbally (systematically miscalibrated). Jev-LCT is an open-source System-One decision engine that takes a third route — extracting calibrated probabilities directly from a transformer's internal recurrent dynamics. Parallel Looped Prefill: recurrently recomputes only the top k=2 layers of a causal transformer, preserving full representation fidelity. Endogenous Trajectory Confidence: reads calibrated probabilities from hidden-state convergence dynamics (cos