Coinbase's Autopilot Adds a Quality Loop to Its AI Customer Support Bots
Coinbase's engineering team has described Autopilot, a system that works behind the scenes to maintain its customer support bots rather than interacting with customers directly. The pipeline has agents write, test, probe, score, and analyze the versioned decision-tree procedures that support bots follow. The approach treats support automation as software requiring repeatable validation, since changes to procedures, models, or data interfaces can alter outcomes without warning. Autopilot pairs exploratory agents with deterministic services that grade results, and uses shared test contracts so Coinbase's bots and partner bots can be evaluated on identical inputs. The published account offers detailed architecture but no quantified results after deployment, such as changes in testing time or customer resolution and satisfaction scores.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in