Assigning Unique Run IDs to Each Test Eliminates Flaky Notification Jobs

Flaky notification tests often fail not because of email complexity but because workflows lack a single identity per execution, causing workers and checks to mix up messages across runs. A developer found that assigning one unique Run ID at the start of each workflow — and threading it through every component, alias, and payload — resolved most of these ambiguities. The approach replaces vague inbox-level checks with strict assertions tied to a specific recipient, event, and expected message count for that run. The same mental model applies beyond email, covering Slack alerts, webhook callbacks, and SMS checks that fail for identical reasons. When a job fails under this setup, the error clearly identifies whether delivery, metadata, or deduplication broke — removing guesswork from debugging.