NEXUS: AI Operations Agent Built on Zero Trust Principles Inside Istio Service Mesh

A developer has built NEXUS, an AI-powered operations agent running on Amazon EKS within an Istio service mesh, designed to diagnose production incidents without having the ability to modify the workloads it monitors. The system follows a Zero Trust model, treating the AI agent like any other cluster workload — assigning it a dedicated Kubernetes namespace, a SPIFFE cryptographic identity, and read-only access to observability tools like Prometheus, Jaeger, and Kiali. Every 30 seconds, NEXUS polls metrics and, when error thresholds are breached, submits a structured telemetry snapshot to Anthropic's Claude Sonnet model, which returns a JSON-formatted diagnosis including severity, root cause, and a remediation proposal. In a controlled test using Chaos Mesh, NEXUS correctly detected a 56.5% error rate in a specific backend service within one polling cycle and accurately isolated the fault domain. Human approval is required before any remediation is executed, keeping engineers in control while shortening the time from detection to diagnosis.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in