Uptime monitoring for experiments should separate reachability, job deadlines, and cohort outcomes
A green uptime aggregate can conceal damage to a single experiment cohort, so the article argues that rollback decisions need more than a global availability figure. It recommends three distinct signals: external probes for reachability, heartbeat deadlines for scheduled jobs, and cohort-tagged application outcomes that drive rollback. The author notes that a health endpoint cannot verify whether a new rule works for a specific cohort or whether jobs finished on time. To control metric cardinality and privacy exposure, the piece advises emitting only stable cohort names rather than raw tenant identifiers, and keeping identifiers out of URLs and public status pages.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in