How Multi-Tenant AI Chat Systems Evolve From Simple Config to BYOK Architecture

·2 views

A software engineering walkthrough published on DEV Community outlines four progressive stages in building a multi-tenant AI chat system, starting from a hardcoded configuration object supporting two tenants with different AI providers. Within a week of launch, tenants requested the ability to update their own prompts without requiring a code deployment, prompting a shift to a database-backed settings table with an admin UI. A subsequent incident — where a tenant's chatbot began responding unexpectedly with no audit trail — exposed the limitations of mutable database rows, leading to an event-sourced configuration model that logs every change with a timestamp and actor. The article uses real-world Slack requests as the catalyst for each architectural upgrade, illustrating how seemingly simple systems grow in complexity as user demands increase.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

PromptOT Adds MCP Server to Let AI Coding Tools Manage Production Prompts

PromptOT, a prompt management platform for production LLM applications, has integrated a Model Context Protocol (MCP) server to allow AI coding assistants like Claude, Cursor, and Codex to interact directly with prompt workspaces. Previously, developers had to leave their AI tools and manually update prompts through a separate dashboard, creating a disruptive context switch. The new MCP server exposes 23 structured tools across five areas, enabling assistants to list, create, update, version, and publish prompts without unrestricted database access. Using the standardized MCP protocol means PromptOT needs only one integration instead of separate custom builds for each AI client. The update allows teams to manage prompt blocks, runtime variables, versioning, and rollbacks entirely from within their preferred AI-assisted development environment.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AI Is Forcing Developers to Rethink the Culture of Building in Public

For years, developers built credibility by openly sharing code, blog posts, and ideas — but the rise of AI is disrupting that culture. Detailed technical content published online can now be fed into large language models and rapidly turned into working prototypes, pitch decks, or monetizable products, eroding the link between an original idea and its creator. Attribution has become harder to trace as AI-generated implementations obscure the lineage of shared concepts. In response, many developers are shifting toward sharing the 'why' behind their work rather than the 'how,' and gravitating toward private, trust-based communities instead of open forums. While the open-source social contract of the 2010s may be fading, developers argue their edge lies in taste, lived experience, and the judgment to decide what is worth building — qualities AI cannot replicate.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

CSP via Meta Tag: How It Works, Its Limits, and When to Use It

Developers can define a Content Security Policy directly in HTML using a meta tag instead of HTTP response headers, which is useful for static sites, prototypes, and platforms like GitHub Pages that do not allow custom headers. However, the meta tag approach has notable limitations: the browser only enforces the policy after parsing the tag, meaning resources loaded earlier may bypass it. Several directives — including report-uri, report-to, frame-ancestors, and sandbox — are ignored when set via a meta tag, eliminating violation reporting and clickjacking protection. HTTP response headers are processed before any page content renders, making them the stronger and preferred option for production environments. Best practice recommends reserving the meta tag method for development or constrained environments, and always placing it as early as possible within the document head.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How Replacing a Metrics God Class with Per-Subsystem Modules Improved an OTel Codebase

A software team refactored their OpenTelemetry metrics architecture by replacing a single monolithic god class with separate per-subsystem modules, each owning its own instruments. The original design used multiple inheritance mixins on one global Metrics object, which caused silent attribute shadowing and forced developers to call methods through explicit base classes to avoid name collisions. OpenTelemetry's core constraint — that instruments can be created only once per process and never unregistered — means every codebase must carefully manage a process-level singleton. The new pattern solves this with a frozen dataclass holding OTel handles, a memoized factory function acting as the singleton, and a lightweight wrapper class instantiated per request. This approach enforces composition over inheritance, keeping metric definitions close to the code that uses them and eliminating the risk of silently lost metrics.

0 comments Read more at DEV Community