OpenTelemetry and Microsoft Foundry Enable Unified Tracing for Multi-Agent AI Systems

Multi-agent AI architectures present significant observability challenges, as each agent may call different tools and use different underlying language models within a single workflow. OpenTelemetry addresses this by providing standardized semantic conventions that allow developers to collect and route telemetry data consistently across all agents. Microsoft Foundry integrates these conventions to capture details such as user inputs, tool usage, token consumption, and latency in a unified view. A practical example involves a multi-agent incident drill system where specialist agents for logs, metrics, and runbooks report to a central incident commander, all traced end-to-end. Distributed tracing using spans and traces ensures that root causes of failures can be identified across the entire agent workflow rather than in isolation.