How Kraken Migrated 8M Daily RabbitMQ Messages to v4 With Zero Downtime
Engineering teams at Kraken faced a high-stakes upgrade from RabbitMQ v3.13 to v4.2.2, which introduced breaking changes including the removal of Global QoS and Classic Queue Mirroring. With 8 million messages processed daily and strict uptime requirements, the team could not afford service interruptions or data loss during the transition. Their strategy involved spinning up a parallel virtual host running quorum queues bound to topic exchanges, while using a feature flag to gradually shift application pods from the old setup to the new one. Celery's Native Delayed Delivery feature, which requires quorum queues, was leveraged to preserve ETA-based task execution that would otherwise have blocked workers under v4. The migration was executed in rolling phases, ensuring both environments ran simultaneously until all messages and workers were fully transferred to the new configuration.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in